Nov 03 07:16:48 devstack cinder-volume[75866]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 07:16:48 devstack cinder-volume[75866]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 07:16:48 devstack cinder-volume[75866]: we strongly recommend against using it for new projects. Nov 03 07:16:48 devstack cinder-volume[75866]: If you are already using Eventlet, we recommend migrating to a different Nov 03 07:16:48 devstack cinder-volume[75866]: framework. For more detail see Nov 03 07:16:48 devstack cinder-volume[75866]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 07:16:48 devstack cinder-volume[75866]: import eventlet # noqa Nov 03 07:16:51 devstack cinder-volume[75866]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75866) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 07:16:51 devstack cinder-volume[75866]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75866) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 07:16:51 devstack cinder-volume[75866]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75866) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 07:16:52 devstack cinder-volume[75866]: INFO dbcounter [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Registered counter for database cinder Nov 03 07:16:52 devstack cinder-volume[75866]: DEBUG oslo_db.sqlalchemy.engines [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75866) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:16:52 devstack cinder-volume[75866]: DEBUG dbcounter [-] [75866] Writer thread running {{(pid=75866) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 07:16:52 devstack cinder-volume[75866]: INFO cinder.rpc [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 07:16:52 devstack cinder-volume[75866]: INFO cinder.rpc [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 07:16:52 devstack cinder-volume[75866]: DEBUG oslo_db.sqlalchemy.engines [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75866) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:16:52 devstack cinder-volume[75866]: INFO cinder.volume.manager [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Determined volume DB was empty at startup. Nov 03 07:16:52 devstack cinder-volume[75866]: DEBUG cinder.volume.manager [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75866) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 07:16:52 devstack cinder-volume[75866]: INFO cinder.volume.manager [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 07:16:52 devstack cinder-volume[75866]: WARNING stevedore.named [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 07:16:52 devstack cinder-volume[75866]: WARNING castellan.key_manager [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 07:16:52 devstack cinder-volume[75866]: WARNING cinder.keymgr.conf_key_mgr [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 07:16:52 devstack cinder-volume[75866]: DEBUG cinder.volume.drivers.lvm [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75866) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 03 07:16:52 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] CMD "cinder-rtstool verify" returned: 0 in 0.489s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_db.sqlalchemy.engines [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75866) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:16:53 devstack cinder-volume[75866]: INFO cinder.rpc [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 03 07:16:53 devstack cinder-volume[75866]: INFO cinder.rpc [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 03 07:16:53 devstack cinder-volume[75866]: WARNING stevedore.named [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 07:16:53 devstack cinder-volume[75866]: WARNING castellan.key_manager [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 07:16:53 devstack cinder-volume[75866]: INFO cinder.volume.manager [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_db.sqlalchemy.engines [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75866) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:16:53 devstack cinder-volume[75866]: INFO oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Starting 1 workers Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Started child 76022 {{(pid=75866) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Full set of CONF: {{(pid=75866) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] ******************************************************************************** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Configuration options gathered from: {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] ================================================================================ {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] allow_availability_zone_fallback = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] allow_compression_on_image_upload = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[76022]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] allowed_direct_url_schemes = [] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] api_rate_limit = True {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] auth_strategy = keystone {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] az_cache_duration = 3600 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_availability_zone = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_host = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_name = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_stats_polling_interval = 60 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backup_api_class = cinder.backup.api.API {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backup_name_template = backup-%s {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backup_use_same_host = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backup_use_temp_snapshot = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] chap_password = **** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] chap_username = {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cinder_internal_tenant_project_id = 46fc814d0ca04c7f8d6d68c25d1793ab {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cinder_internal_tenant_user_id = 266412aac9f948a3849efe0f1ae3aa46 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cloned_volume_same_az = True {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cluster = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] compression_format = gzip {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] compute_api_class = cinder.compute.nova.API {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] config_dir = [] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] config_source = [] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] control_exchange = openstack {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] debug = True {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] default_availability_zone = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] default_group_type = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] default_volume_type = lvmdriver-1 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] disk_geometry = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] driver_client_cert = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] driver_client_cert_key = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] driver_data_namespace = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] driver_ssl_cert_path = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] driver_ssl_cert_verify = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] driver_use_ssl = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] enable_force_upload = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] enable_new_services = True {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] enable_unsupported_driver = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] enforce_multipath_for_image_xfer = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] filter_function = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] glance_api_insecure = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] glance_api_servers = ['http://192.168.122.25/image'] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] glance_api_ssl_compression = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] glance_ca_certificates_file = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] glance_catalog_info = image:glance:publicURL {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] glance_certfile = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] glance_keyfile = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] glance_num_retries = 3 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] glance_request_timeout = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] goodness_function = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] graceful_shutdown_timeout = 5 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] group_api_class = cinder.group.api.API {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] host = devstack {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] image_compress_on_upload = True {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] image_conversion_address_space_limit = 1 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] image_conversion_cpu_limit = 60 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] image_conversion_disable = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] image_introspection_address_space_limit = 1 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] image_introspection_cpu_limit = 60 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] image_upload_use_cinder_backend = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] image_upload_use_internal_tenant = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] image_volume_cache_enabled = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] image_volume_cache_max_count = 0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] image_volume_cache_max_size_gb = 0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] init_host_max_objects_retrieval = 0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] instance_format = [instance: %(uuid)s] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] iscsi_target_flags = {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] iscsi_write_cache = on {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] iser_helper = tgtadm {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] iser_ip_address = 192.168.122.25 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] iser_port = 3260 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] log_color = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] log_config_append = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] log_dir = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] log_file = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] log_options = True {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] log_rotate_interval = 1 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] log_rotate_interval_type = days {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] log_rotation_type = none {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] max_age = 0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] max_logfile_count = 30 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] max_logfile_size_mb = 200 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] max_over_subscription_ratio = 20.0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] message_reap_interval = 86400 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] message_ttl = 2592000 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] migration_create_volume_timeout_secs = 300 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] monkey_patch = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] monkey_patch_modules = [] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] my_ip = 192.168.122.25 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] no_snapshot_gb_quota = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] num_iser_scan_tries = 3 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[76022]: INFO cinder.volume.manager [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] num_shell_tries = 3 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] num_volume_device_scan_tries = 3 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] nvmeof_conn_info_version = 1 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] nvmet_ns_id = 10 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] nvmet_port_id = 1 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] osapi_max_limit = 1000 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] osapi_volume_ext_list = [] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] osapi_volume_listen_port = 8776 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] osapi_volume_use_ssl = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] osapi_volume_workers = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] per_volume_size_limit = -1 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] periodic_fuzzy_delay = 60 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] periodic_interval = 60 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] public_endpoint = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] publish_errors = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] quota_backup_gigabytes = 1000 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] quota_backups = 10 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] quota_gigabytes = 1000 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] quota_groups = 10 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] quota_snapshots = 10 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] quota_volumes = 10 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] rate_limit_burst = 0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] rate_limit_except_level = CRITICAL {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] rate_limit_interval = 0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] reinit_driver_count = 3 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] replication_device = **** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] report_discard_supported = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] report_interval = 120 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] reservation_clean_interval = 86400 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] reservation_expire = 86400 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] reserved_image_namespaces = [] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] reserved_percentage = 0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] rpc_response_timeout = 120 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] run_external_periodic_tasks = True {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] scst_target_driver = iscsi {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] scst_target_iqn_name = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] service_down_time = 720 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] shell_completion = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] snapshot_name_template = snapshot-%s {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] snapshot_same_host = True {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] split_loggers = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] state_path = /opt/stack/data/cinder {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] storage_availability_zone = nova {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] storage_protocol = iSCSI {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] syslog_log_facility = LOG_USER {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] target_helper = lioadm {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] target_ip_address = 192.168.122.25 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] target_port = 3260 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] target_protocol = iscsi {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] target_secondary_ip_addresses = [] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] trace_flags = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] transport_url = **** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] until_refresh = 0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] use_chap_auth = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] use_default_quota_class = True {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] use_journal = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] use_json = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] use_multipath_for_image_xfer = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] use_stderr = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] use_syslog = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] verify_glance_signatures = enabled {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] volume_api_class = cinder.volume.api.API {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] volume_backend_name = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] volume_clear = zero {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] volume_clear_ionice = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] volume_clear_size = 0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] volume_copy_bps_limit = 0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] volume_dd_blocksize = 1M {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] volume_name_template = volume-%s {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] volume_service_inithost_offload = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] volume_usage_audit_period = month {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] zoning_mode = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_concurrency.disable_process_locking = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:53 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.auth_section = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.auth_type = password {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.auth_version = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.cache = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:53 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.certfile = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.include_service_catalog = True {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.insecure = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.interface = public {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.keyfile = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.memcache_password = **** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.memcache_username = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.region_name = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.service_type = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.25/identity {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.backend = dogpile.cache.null {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.backend_argument = **** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.backend_expiration_time = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.config_prefix = cache.oslo {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.debug_cache_backend = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.enable_retry_client = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.enable_socket_keepalive = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.enabled = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.expiration_time = 600 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.hashclient_retry_attempts = 2 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.memcache_dead_retry = 300 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.memcache_pool_maxsize = 10 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.memcache_sasl_enabled = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.password = **** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.proxies = [] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack sudo[76026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 03 07:16:53 devstack sudo[76026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.redis_db = 0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.redis_server = localhost:6379 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.retry_attempts = 2 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.retry_delay = 0.0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.socket_keepalive_count = 1 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.socket_keepalive_idle = 1 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.socket_keepalive_interval = 1 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.socket_timeout = 1.0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.tls_allowed_ciphers = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.tls_cafile = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.tls_certfile = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.tls_enabled = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.tls_keyfile = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cache.username = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] coordination.backend_url = **** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] database.asyncio_connection = **** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] database.asyncio_slave_connection = **** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] database.backend = sqlalchemy {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] database.connection = **** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] database.connection_debug = 0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] database.connection_parameters = {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] database.connection_recycle_time = 3600 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] database.connection_trace = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] database.db_inc_retry_interval = True {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] database.db_max_retries = 20 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] database.db_max_retry_interval = 10 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] database.db_retry_interval = 1 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] database.max_overflow = 50 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] database.max_pool_size = 5 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] database.max_retries = 10 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] database.mysql_wsrep_sync_wait = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] database.pool_timeout = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] database.retry_interval = 10 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] database.slave_connection = **** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] database.sqlite_synchronous = True {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] database.synchronous_reader = True {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] database.use_db_reconnect = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_tracing.insecure = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] profiler.connection_string = messaging:// {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] profiler.enabled = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] profiler.es_doc_type = notification {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] profiler.es_scroll_size = 10000 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] profiler.es_scroll_time = 2m {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] profiler.filter_error_trace = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] profiler.hmac_keys = **** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] profiler.sentinel_service_name = mymaster {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] profiler.socket_timeout = 0.1 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] profiler.trace_requests = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] profiler.trace_sqlalchemy = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] profiler_jaeger.process_tags = {} {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] profiler_jaeger.service_name_prefix = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] profiler_otlp.service_name_prefix = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_policy.enforce_new_defaults = True {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_policy.policy_default_rule = default {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_policy.policy_file = policy.yaml {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] privsep_osbrick.group = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] privsep_osbrick.helper_command = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] privsep_osbrick.user = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cinder_sys_admin.group = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cinder_sys_admin.helper_command = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] cinder_sys_admin.user = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] service_user.auth_section = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] service_user.auth_type = password {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] service_user.cafile = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] service_user.certfile = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] service_user.collect_timing = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] service_user.insecure = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] service_user.keyfile = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] service_user.send_service_user_token = True {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] service_user.split_loggers = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] service_user.timeout = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] service_user.tls_ciphers = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] service_user.tls_min_version = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] glance.auth_section = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] glance.auth_type = password {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] glance.certfile = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] glance.collect_timing = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] glance.insecure = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] glance.keyfile = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] glance.region_name = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] glance.split_loggers = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] glance.timeout = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] glance.tls_ciphers = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] glance.tls_min_version = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.backend_availability_zone = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.chap_password = **** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.chap_username = {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.disk_geometry = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.driver_client_cert = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.driver_client_cert_key = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.driver_data_namespace = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.driver_use_ssl = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.extra_capabilities = {} {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.filter_function = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.goodness_function = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.iscsi_target_flags = {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.iscsi_write_cache = on {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.iser_helper = tgtadm {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.iser_ip_address = 192.168.122.25 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.iser_port = 3260 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.lvm_share_target = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.lvm_type = auto {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.num_shell_tries = 3 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.replication_device = **** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.report_discard_supported = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.reserved_percentage = 0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.target_helper = tgtadm {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.target_ip_address = 192.168.122.25 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.target_port = 3260 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.target_protocol = iscsi {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.trace_flags = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.unique_fqdn_network = True {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.use_chap_auth = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.volume_backend_name = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.volume_clear = zero {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.volume_clear_ionice = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.volume_clear_size = 0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_reports.file_event_handler = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_reports.log_dir = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.backend_host = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.chap_password = **** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.chap_username = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.disk_geometry = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.driver_client_cert = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.extra_capabilities = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.filter_function = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.goodness_function = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.iser_helper = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.iser_ip_address = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.iser_port = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.lvm_share_target = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.lvm_type = auto {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.num_shell_tries = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.replication_device = **** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.report_discard_supported = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.reserved_percentage = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.scst_target_driver = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.storage_protocol = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.target_helper = lioadm {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.target_ip_address = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.target_port = 3260 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.trace_flags = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.use_chap_auth = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.volume_clear = zero {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.volume_clear_size = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] lvmdriver-1.volumes_dir = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.ssl = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_notifications.driver = [] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_notifications.retry = -1 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] key_manager.fixed_key = **** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican.barbican_api_version = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican.barbican_endpoint = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican.barbican_endpoint_type = public {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican.barbican_region_name = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican.cafile = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican.certfile = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican.collect_timing = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican.insecure = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican.keyfile = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican.number_of_retries = 60 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican.retry_delay = 1 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican.send_service_user_token = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican.split_loggers = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican.timeout = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican.tls_ciphers = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican.tls_min_version = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican.verify_ssl = True {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican.verify_ssl_path = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican_service_user.auth_section = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican_service_user.auth_type = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican_service_user.cafile = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican_service_user.certfile = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican_service_user.collect_timing = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican_service_user.insecure = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican_service_user.keyfile = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican_service_user.split_loggers = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican_service_user.timeout = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican_service_user.tls_ciphers = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] barbican_service_user.tls_min_version = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] vault.approle_role_id = **** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] vault.approle_secret_id = **** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] vault.auth_method = approle {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] vault.auth_path = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] vault.kv_mountpoint = secret {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] vault.kv_path = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] vault.kv_version = 2 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] vault.namespace = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] vault.root_token_id = **** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] vault.ssl_ca_crt_file = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] vault.timeout = 60.0 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] vault.token_file = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] vault.token_role = None {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] vault.use_ssl = False {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:16:53 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] ******************************************************************************** {{(pid=75866) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 07:16:54 devstack sudo[76026]: pam_unix(sudo:session): session closed for user root Nov 03 07:16:54 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:54 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:54 devstack sudo[76185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:16:54 devstack sudo[76185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:16:54 devstack sudo[76185]: pam_unix(sudo:session): session closed for user root Nov 03 07:16:54 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.300s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:54 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:16:54 devstack cinder-volume[76022]: INFO cinder.brick.local_dev.lvm [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 03 07:16:54 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:54 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:54 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:54 devstack sudo[76285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:16:54 devstack sudo[76285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:16:54 devstack sudo[76285]: pam_unix(sudo:session): session closed for user root Nov 03 07:16:54 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:54 devstack cinder-volume[76022]: DEBUG cinder.brick.local_dev.lvm [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76022) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 03 07:16:54 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:54 devstack sudo[76388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:16:54 devstack sudo[76388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:16:55 devstack sudo[76388]: pam_unix(sudo:session): session closed for user root Nov 03 07:16:55 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.507s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:55 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:55 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:55 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:55 devstack sudo[76577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:16:55 devstack sudo[76577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:16:55 devstack sudo[76577]: pam_unix(sudo:session): session closed for user root Nov 03 07:16:55 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.332s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:55 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:55 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:55 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:55 devstack sudo[76638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 03 07:16:55 devstack sudo[76638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:16:55 devstack sudo[76638]: pam_unix(sudo:session): session closed for user root Nov 03 07:16:55 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.293s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:55 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:55 devstack sudo[76695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:16:55 devstack sudo[76695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:16:56 devstack sudo[76695]: pam_unix(sudo:session): session closed for user root Nov 03 07:16:56 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.325s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:56 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:56 devstack sudo[76725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:16:56 devstack sudo[76725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:16:56 devstack sudo[76725]: pam_unix(sudo:session): session closed for user root Nov 03 07:16:56 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.357s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:56 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:56 devstack sudo[76748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:16:56 devstack sudo[76748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:16:56 devstack sudo[76748]: pam_unix(sudo:session): session closed for user root Nov 03 07:16:56 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.349s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:56 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:56 devstack sudo[76817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:16:56 devstack sudo[76817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:16:57 devstack sudo[76817]: pam_unix(sudo:session): session closed for user root Nov 03 07:16:57 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:57 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:57 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:57 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:57 devstack sudo[76821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:16:57 devstack sudo[76821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:16:57 devstack sudo[76821]: pam_unix(sudo:session): session closed for user root Nov 03 07:16:57 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:57 devstack cinder-volume[76022]: INFO cinder.volume.drivers.lvm [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 03 07:16:57 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:57 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:57 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:57 devstack sudo[76826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:16:57 devstack sudo[76826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:16:57 devstack sudo[76826]: pam_unix(sudo:session): session closed for user root Nov 03 07:16:57 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.302s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:57 devstack cinder-volume[76022]: DEBUG cinder.volume.drivers.lvm [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Updating volume stats {{(pid=76022) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 07:16:57 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:57 devstack sudo[76835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:16:57 devstack sudo[76835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:16:58 devstack sudo[76835]: pam_unix(sudo:session): session closed for user root Nov 03 07:16:58 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:58 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:58 devstack sudo[76838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:16:58 devstack sudo[76838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:16:58 devstack sudo[76838]: pam_unix(sudo:session): session closed for user root Nov 03 07:16:58 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:58 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:58 devstack sudo[76841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:16:58 devstack sudo[76841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:16:58 devstack sudo[76841]: pam_unix(sudo:session): session closed for user root Nov 03 07:16:58 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.320s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:58 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:58 devstack sudo[76844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:16:58 devstack sudo[76844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:16:59 devstack sudo[76844]: pam_unix(sudo:session): session closed for user root Nov 03 07:16:59 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:59 devstack cinder-volume[76022]: INFO cinder.volume.driver [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Driver hasn't implemented _init_vendor_properties() Nov 03 07:16:59 devstack cinder-volume[76022]: DEBUG cinder.volume.driver [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76022) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 07:16:59 devstack cinder-volume[76022]: DEBUG oslo_db.sqlalchemy.engines [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76022) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:16:59 devstack cinder-volume[76022]: DEBUG dbcounter [-] [76022] Writer thread running {{(pid=76022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 07:16:59 devstack cinder-volume[76022]: DEBUG cinder.db.api [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Building query based on filter {{(pid=76022) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 07:16:59 devstack cinder-volume[76022]: DEBUG cinder.image.image_utils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76022) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 07:16:59 devstack cinder-volume[76022]: INFO cinder.keymgr.migration [None req-7f64379e-2ba3-4eea-98b9-c8d40d220c36 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 07:16:59 devstack cinder-volume[76022]: DEBUG cinder.volume.drivers.lvm [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Updating volume stats {{(pid=76022) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 07:16:59 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:59 devstack sudo[76848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:16:59 devstack sudo[76848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:16:59 devstack sudo[76848]: pam_unix(sudo:session): session closed for user root Nov 03 07:16:59 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:59 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:59 devstack sudo[76852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:16:59 devstack sudo[76852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:16:59 devstack sudo[76852]: pam_unix(sudo:session): session closed for user root Nov 03 07:16:59 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:16:59 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:16:59 devstack sudo[76856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:16:59 devstack sudo[76856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:17:00 devstack sudo[76856]: pam_unix(sudo:session): session closed for user root Nov 03 07:17:00 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.293s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:17:00 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:17:00 devstack sudo[76859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:17:00 devstack sudo[76859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:17:00 devstack sudo[76859]: pam_unix(sudo:session): session closed for user root Nov 03 07:17:00 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:17:00 devstack cinder-volume[76022]: DEBUG cinder.manager [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Notifying Schedulers of capabilities ... {{(pid=76022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:17:00 devstack cinder-volume[76022]: INFO cinder.volume.manager [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Driver initialization completed successfully. Nov 03 07:17:00 devstack cinder-volume[76022]: INFO cinder.manager [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Initiating service 2 cleanup Nov 03 07:17:00 devstack cinder-volume[76022]: INFO cinder.manager [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Service 2 cleanup completed. Nov 03 07:17:00 devstack cinder-volume[76022]: DEBUG cinder.service [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Creating RPC server for service cinder-volume {{(pid=76022) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 07:17:00 devstack cinder-volume[76022]: DEBUG cinder.service [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76022) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 07:17:00 devstack cinder-volume[76022]: INFO cinder.volume.manager [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 03 07:17:00 devstack cinder-volume[76022]: DEBUG cinder.volume.drivers.lvm [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Updating volume stats {{(pid=76022) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 07:17:00 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:17:00 devstack sudo[76863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:17:00 devstack sudo[76863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:17:00 devstack sudo[76863]: pam_unix(sudo:session): session closed for user root Nov 03 07:17:00 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.318s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:17:00 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:17:00 devstack sudo[76867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:17:00 devstack sudo[76867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:17:01 devstack sudo[76867]: pam_unix(sudo:session): session closed for user root Nov 03 07:17:01 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:17:01 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:17:01 devstack sudo[76873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:17:01 devstack sudo[76873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:17:01 devstack sudo[76873]: pam_unix(sudo:session): session closed for user root Nov 03 07:17:01 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.331s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:17:01 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:17:01 devstack sudo[76876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:17:01 devstack sudo[76876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:17:01 devstack sudo[76876]: pam_unix(sudo:session): session closed for user root Nov 03 07:17:01 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.335s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:17:01 devstack cinder-volume[76022]: INFO cinder.volume.manager [None req-edf9d11c-470c-4fd4-81c7-9ea82d32294d None None] Driver post RPC initialization completed successfully. Nov 03 07:17:03 devstack cinder-volume[75866]: DEBUG dbcounter [-] [75866] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75866) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:17:11 devstack cinder-volume[76022]: DEBUG dbcounter [-] [76022] Writing DB stats cinder:SELECT=4 {{(pid=76022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:17:11 devstack cinder-volume[76022]: DEBUG dbcounter [-] [76022] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:17:28 devstack cinder-volume[76022]: DEBUG oslo_service.periodic_task [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running periodic task VolumeManager._thread_info {{(pid=76022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:17:28 devstack cinder-volume[76022]: DEBUG cinder.volume.manager [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] thread count: 6 {{(pid=76022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:17:28 devstack cinder-volume[76022]: DEBUG cinder.volume.manager [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] thread info: [<_MainThread(MainThread, started 133638081343616)>, , , , , ] {{(pid=76022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:18:28 devstack cinder-volume[76022]: DEBUG oslo_service.periodic_task [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:18:28 devstack cinder-volume[76022]: DEBUG cinder.volume.drivers.lvm [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Updating volume stats {{(pid=76022) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 07:18:28 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:18:28 devstack sudo[79447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:18:28 devstack sudo[79447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:18:29 devstack sudo[79447]: pam_unix(sudo:session): session closed for user root Nov 03 07:18:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:18:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:18:29 devstack sudo[79450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:18:29 devstack sudo[79450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:18:29 devstack sudo[79450]: pam_unix(sudo:session): session closed for user root Nov 03 07:18:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:18:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:18:29 devstack sudo[79503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:18:29 devstack sudo[79503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:18:29 devstack sudo[79503]: pam_unix(sudo:session): session closed for user root Nov 03 07:18:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:18:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:18:29 devstack sudo[79674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:18:29 devstack sudo[79674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:18:30 devstack sudo[79674]: pam_unix(sudo:session): session closed for user root Nov 03 07:18:30 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:18:30 devstack cinder-volume[76022]: DEBUG cinder.manager [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Notifying Schedulers of capabilities ... {{(pid=76022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:18:30 devstack cinder-volume[76022]: DEBUG oslo_service.periodic_task [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running periodic task VolumeManager._thread_info {{(pid=76022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:18:30 devstack cinder-volume[76022]: DEBUG cinder.volume.manager [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] thread count: 6 {{(pid=76022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:18:30 devstack cinder-volume[76022]: DEBUG cinder.volume.manager [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] thread info: [<_MainThread(MainThread, started 133638081343616)>, , , , , ] {{(pid=76022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:19:11 devstack cinder-volume[76022]: DEBUG dbcounter [-] [76022] Writing DB stats cinder:SELECT=1 {{(pid=76022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:19:11 devstack cinder-volume[76022]: DEBUG dbcounter [-] [76022] Writing DB stats cinder:UPDATE=1 {{(pid=76022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:19:28 devstack cinder-volume[76022]: DEBUG oslo_service.periodic_task [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:19:28 devstack cinder-volume[76022]: DEBUG cinder.volume.drivers.lvm [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Updating volume stats {{(pid=76022) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 07:19:28 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:19:28 devstack sudo[82468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:19:28 devstack sudo[82468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:19:29 devstack sudo[82468]: pam_unix(sudo:session): session closed for user root Nov 03 07:19:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:19:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:19:29 devstack sudo[82471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:19:29 devstack sudo[82471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:19:29 devstack sudo[82471]: pam_unix(sudo:session): session closed for user root Nov 03 07:19:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:19:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:19:29 devstack sudo[82474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:19:29 devstack sudo[82474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:19:29 devstack sudo[82474]: pam_unix(sudo:session): session closed for user root Nov 03 07:19:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.327s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:19:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:19:29 devstack sudo[82478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:19:29 devstack sudo[82478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:19:30 devstack sudo[82478]: pam_unix(sudo:session): session closed for user root Nov 03 07:19:30 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:19:30 devstack cinder-volume[76022]: DEBUG cinder.manager [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Notifying Schedulers of capabilities ... {{(pid=76022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:19:30 devstack cinder-volume[76022]: DEBUG oslo_service.periodic_task [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running periodic task VolumeManager._thread_info {{(pid=76022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:19:30 devstack cinder-volume[76022]: DEBUG cinder.volume.manager [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] thread count: 6 {{(pid=76022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:19:30 devstack cinder-volume[76022]: DEBUG cinder.volume.manager [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] thread info: [<_MainThread(MainThread, started 133638081343616)>, , , , , ] {{(pid=76022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:20:28 devstack cinder-volume[76022]: DEBUG oslo_service.periodic_task [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:20:28 devstack cinder-volume[76022]: DEBUG cinder.volume.drivers.lvm [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Updating volume stats {{(pid=76022) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 07:20:28 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:20:28 devstack sudo[84588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:20:28 devstack sudo[84588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:20:29 devstack sudo[84588]: pam_unix(sudo:session): session closed for user root Nov 03 07:20:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:20:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:20:29 devstack sudo[84596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:20:29 devstack sudo[84596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:20:29 devstack sudo[84596]: pam_unix(sudo:session): session closed for user root Nov 03 07:20:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:20:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:20:29 devstack sudo[84603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:20:29 devstack sudo[84603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:20:29 devstack sudo[84603]: pam_unix(sudo:session): session closed for user root Nov 03 07:20:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.313s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:20:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:20:29 devstack sudo[84612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:20:29 devstack sudo[84612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:20:30 devstack sudo[84612]: pam_unix(sudo:session): session closed for user root Nov 03 07:20:30 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:20:30 devstack cinder-volume[76022]: DEBUG cinder.manager [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Notifying Schedulers of capabilities ... {{(pid=76022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:20:30 devstack cinder-volume[76022]: DEBUG oslo_service.periodic_task [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running periodic task VolumeManager._thread_info {{(pid=76022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:20:30 devstack cinder-volume[76022]: DEBUG cinder.volume.manager [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] thread count: 6 {{(pid=76022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:20:30 devstack cinder-volume[76022]: DEBUG cinder.volume.manager [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] thread info: [<_MainThread(MainThread, started 133638081343616)>, , , , , ] {{(pid=76022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:21:11 devstack cinder-volume[76022]: DEBUG dbcounter [-] [76022] Writing DB stats cinder:SELECT=1 {{(pid=76022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:21:11 devstack cinder-volume[76022]: DEBUG dbcounter [-] [76022] Writing DB stats cinder:UPDATE=1 {{(pid=76022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:21:28 devstack cinder-volume[76022]: DEBUG oslo_service.periodic_task [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:21:28 devstack cinder-volume[76022]: DEBUG cinder.volume.drivers.lvm [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Updating volume stats {{(pid=76022) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 07:21:28 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:28 devstack sudo[85596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:21:28 devstack sudo[85596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:29 devstack sudo[85596]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.334s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:29 devstack sudo[85607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:21:29 devstack sudo[85607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:29 devstack sudo[85607]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:29 devstack sudo[85610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:21:29 devstack sudo[85610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:29 devstack sudo[85610]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.328s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:29 devstack sudo[85616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:21:29 devstack sudo[85616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:30 devstack sudo[85616]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:30 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.320s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:30 devstack cinder-volume[76022]: DEBUG cinder.manager [None req-527255cb-5e0e-4d81-b5cb-4ee27a820b9b None None] Notifying Schedulers of capabilities ... {{(pid=76022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:21:51 devstack cinder-volume[75866]: INFO oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Caught SIGTERM, stopping children Nov 03 07:21:51 devstack cinder-volume[75866]: DEBUG oslo_concurrency.lockutils [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Acquiring lock "singleton_lock" {{(pid=75866) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 07:21:51 devstack cinder-volume[75866]: DEBUG oslo_concurrency.lockutils [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Acquired lock "singleton_lock" {{(pid=75866) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 07:21:51 devstack cinder-volume[75866]: DEBUG oslo_concurrency.lockutils [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Releasing lock "singleton_lock" {{(pid=75866) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 07:21:51 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Stop services. {{(pid=75866) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 07:21:51 devstack cinder-volume[75866]: DEBUG oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Killing children. {{(pid=75866) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 07:21:51 devstack cinder-volume[75866]: INFO oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Waiting on 1 children to exit Nov 03 07:21:55 devstack cinder-volume[76022]: DEBUG oslo_concurrency.lockutils [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Acquiring lock "singleton_lock" {{(pid=76022) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 07:21:55 devstack cinder-volume[76022]: DEBUG oslo_concurrency.lockutils [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Acquired lock "singleton_lock" {{(pid=76022) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 07:21:55 devstack cinder-volume[76022]: DEBUG oslo_concurrency.lockutils [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Releasing lock "singleton_lock" {{(pid=76022) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 07:21:55 devstack cinder-volume[76022]: WARNING amqp [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 07:21:55 devstack cinder-volume[76022]: WARNING amqp [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 07:21:55 devstack cinder-volume[75866]: INFO oslo_service.backend._eventlet.service [None req-5a590e36-3d70-42f1-a20d-0d4b1550e869 None None] Child 76022 exited with status 0 Nov 03 07:21:56 devstack cinder-volume[86131]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 07:21:56 devstack cinder-volume[86131]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 07:21:56 devstack cinder-volume[86131]: we strongly recommend against using it for new projects. Nov 03 07:21:56 devstack cinder-volume[86131]: If you are already using Eventlet, we recommend migrating to a different Nov 03 07:21:56 devstack cinder-volume[86131]: framework. For more detail see Nov 03 07:21:56 devstack cinder-volume[86131]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 07:21:56 devstack cinder-volume[86131]: import eventlet # noqa Nov 03 07:21:58 devstack cinder-volume[86131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86131) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 07:21:58 devstack cinder-volume[86131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86131) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 07:21:58 devstack cinder-volume[86131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86131) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 07:21:59 devstack cinder-volume[86131]: INFO dbcounter [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Registered counter for database cinder Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_db.sqlalchemy.engines [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86131) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG dbcounter [-] [86131] Writer thread running {{(pid=86131) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 07:21:59 devstack cinder-volume[86131]: INFO cinder.rpc [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 07:21:59 devstack cinder-volume[86131]: INFO cinder.rpc [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_db.sqlalchemy.engines [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86131) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:21:59 devstack cinder-volume[86131]: INFO cinder.volume.manager [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Determined volume DB was empty at startup. Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG cinder.volume.manager [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86131) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 07:21:59 devstack cinder-volume[86131]: INFO cinder.volume.manager [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 07:21:59 devstack cinder-volume[86131]: WARNING stevedore.named [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 07:21:59 devstack cinder-volume[86131]: WARNING castellan.key_manager [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 07:21:59 devstack cinder-volume[86131]: WARNING cinder.keymgr.conf_key_mgr [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 07:21:59 devstack cinder-volume[86131]: INFO cinder.volume.manager [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_db.sqlalchemy.engines [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86131) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:21:59 devstack cinder-volume[86131]: INFO oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Starting 1 workers Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Started child 86348 {{(pid=86131) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Full set of CONF: {{(pid=86131) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] ******************************************************************************** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Configuration options gathered from: {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 07:21:59 devstack cinder-volume[86348]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] ================================================================================ {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] allow_availability_zone_fallback = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] allow_compression_on_image_upload = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] allowed_direct_url_schemes = [] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] api_rate_limit = True {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] auth_strategy = keystone {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_availability_zone = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_host = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_name = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_stats_polling_interval = 60 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backup_api_class = cinder.backup.api.API {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backup_name_template = backup-%s {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backup_use_same_host = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backup_use_temp_snapshot = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] chap_password = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] chap_username = {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cinder_internal_tenant_project_id = 46fc814d0ca04c7f8d6d68c25d1793ab {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cinder_internal_tenant_user_id = 266412aac9f948a3849efe0f1ae3aa46 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cluster = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] compression_format = gzip {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] compute_api_class = cinder.compute.nova.API {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] config_dir = [] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] config_source = [] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] control_exchange = openstack {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] debug = True {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] default_availability_zone = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] default_group_type = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] default_volume_type = QuobyteHD {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] disk_geometry = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] driver_client_cert = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] driver_client_cert_key = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] driver_data_namespace = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] driver_ssl_cert_path = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] driver_ssl_cert_verify = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] driver_use_ssl = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] enable_new_services = True {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] enable_unsupported_driver = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] enabled_backends = ['QuobyteHD'] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] enforce_multipath_for_image_xfer = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] filter_function = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] glance_api_insecure = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] glance_api_servers = ['http://192.168.122.25/image'] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] glance_api_ssl_compression = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] glance_ca_certificates_file = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] glance_catalog_info = image:glance:publicURL {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] glance_certfile = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] glance_keyfile = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] glance_num_retries = 3 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] glance_request_timeout = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] goodness_function = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] graceful_shutdown_timeout = 5 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] group_api_class = cinder.group.api.API {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] host = devstack {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] image_compress_on_upload = True {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] image_conversion_address_space_limit = 1 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:59 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] image_conversion_cpu_limit = 60 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] image_conversion_disable = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] image_introspection_address_space_limit = 1 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] image_introspection_cpu_limit = 60 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] image_upload_use_cinder_backend = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] image_upload_use_internal_tenant = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] image_volume_cache_enabled = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] image_volume_cache_max_count = 0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] image_volume_cache_max_size_gb = 0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] init_host_max_objects_retrieval = 0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] instance_format = [instance: %(uuid)s] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] iscsi_target_flags = {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] iscsi_write_cache = on {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] iser_helper = tgtadm {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] iser_ip_address = 192.168.122.25 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] iser_port = 3260 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] log_color = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] log_config_append = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] log_dir = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] log_file = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] log_options = True {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] log_rotate_interval = 1 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] log_rotate_interval_type = days {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86348]: INFO cinder.volume.manager [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] log_rotation_type = none {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86348]: DEBUG cinder.volume.drivers.remotefs [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86348) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] max_age = 0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] max_logfile_count = 30 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] max_logfile_size_mb = 200 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] max_over_subscription_ratio = 20.0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] message_reap_interval = 86400 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] message_ttl = 2592000 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] migration_create_volume_timeout_secs = 300 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] monkey_patch = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] monkey_patch_modules = [] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] my_ip = 192.168.122.25 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] no_snapshot_gb_quota = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] num_iser_scan_tries = 3 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] num_shell_tries = 3 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] num_volume_device_scan_tries = 3 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] nvmeof_conn_info_version = 1 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] nvmet_ns_id = 10 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] nvmet_port_id = 1 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] osapi_max_limit = 1000 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] osapi_volume_ext_list = [] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] osapi_volume_listen = 0.0.0.0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] osapi_volume_listen_port = 8776 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] osapi_volume_use_ssl = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] osapi_volume_workers = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] per_volume_size_limit = -1 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] periodic_fuzzy_delay = 60 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] periodic_interval = 60 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] project_id_regex = [0-9a-f\-]+ {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] public_endpoint = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] publish_errors = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] quota_backup_gigabytes = 1000 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] quota_backups = 10 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] quota_gigabytes = 1000 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] quota_groups = 10 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] quota_snapshots = 10 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] quota_volumes = 10 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] rate_limit_burst = 0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] rate_limit_except_level = CRITICAL {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] rate_limit_interval = 0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] reinit_driver_count = 3 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] replication_device = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] report_discard_supported = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] report_interval = 120 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] reservation_clean_interval = 86400 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] reservation_expire = 86400 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] reserved_image_namespaces = [] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] reserved_percentage = 0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] rpc_response_timeout = 120 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] run_external_periodic_tasks = True {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] scst_target_driver = iscsi {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] scst_target_iqn_name = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] service_down_time = 720 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] shell_completion = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] snapshot_name_template = snapshot-%s {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] split_loggers = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] state_path = /opt/stack/data/cinder {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] storage_availability_zone = nova {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] storage_protocol = iSCSI {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] syslog_log_facility = LOG_USER {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] target_helper = lioadm {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] target_ip_address = 192.168.122.25 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] target_port = 3260 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] target_protocol = iscsi {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] target_secondary_ip_addresses = [] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] trace_flags = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] transfer_api_class = cinder.transfer.api.API {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] transport_url = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] until_refresh = 0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] use_chap_auth = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] use_default_quota_class = True {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] use_journal = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] use_json = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] use_multipath_for_image_xfer = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] use_stderr = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] use_syslog = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] verify_glance_signatures = enabled {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] volume_api_class = cinder.volume.api.API {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] volume_backend_name = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] volume_clear = zero {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] volume_clear_ionice = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] volume_clear_size = 0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] volume_copy_bps_limit = 0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] volume_dd_blocksize = 1M {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] volume_name_template = volume-%s {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] volume_service_inithost_offload = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] volume_usage_audit_period = month {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] zoning_mode = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_concurrency.disable_process_locking = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86348]: DEBUG cinder.volume.drivers.quobyte [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86348) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 07:22:00 devstack cinder-volume[86348]: WARNING cinder.volume.drivers.quobyte [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 07:22:00 devstack cinder-volume[86348]: WARNING cinder.volume.drivers.quobyte [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.auth_section = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.auth_type = password {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86348]: DEBUG oslo_concurrency.processutils [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Running cmd (subprocess): mount.quobyte {{(pid=86348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.auth_version = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.cache = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.certfile = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.delay_auth_decision = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.http_connect_timeout = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.include_service_catalog = True {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.insecure = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.interface = public {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.keyfile = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.memcache_password = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.memcache_username = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.region_name = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.service_token_roles_required = True {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.service_type = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.token_cache_time = 300 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.25/identity {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.backend = dogpile.cache.null {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.backend_argument = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.backend_expiration_time = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.config_prefix = cache.oslo {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.debug_cache_backend = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.enable_retry_client = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.enable_socket_keepalive = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.enabled = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.expiration_time = 600 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.hashclient_retry_attempts = 2 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.memcache_dead_retry = 300 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.memcache_pool_maxsize = 10 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.memcache_sasl_enabled = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.password = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.proxies = [] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.redis_db = 0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.redis_sentinel_service_name = mymaster {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.redis_server = localhost:6379 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.retry_attempts = 2 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.retry_delay = 0.0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.socket_keepalive_count = 1 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.socket_keepalive_idle = 1 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.socket_keepalive_interval = 1 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.socket_timeout = 1.0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.tls_allowed_ciphers = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.tls_cafile = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.tls_certfile = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.tls_enabled = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.tls_keyfile = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cache.username = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] coordination.backend_url = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] database.asyncio_connection = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] database.asyncio_slave_connection = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] database.backend = sqlalchemy {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] database.connection = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] database.connection_debug = 0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] database.connection_parameters = {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] database.connection_recycle_time = 3600 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] database.connection_trace = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] database.db_inc_retry_interval = True {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] database.db_max_retries = 20 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] database.db_max_retry_interval = 10 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] database.db_retry_interval = 1 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] database.max_overflow = 50 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] database.max_pool_size = 5 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] database.max_retries = 10 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] database.mysql_wsrep_sync_wait = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] database.pool_timeout = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] database.retry_interval = 10 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] database.slave_connection = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] database.sqlite_synchronous = True {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] database.synchronous_reader = True {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] database.use_db_reconnect = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_tracing.insecure = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] profiler.connection_string = messaging:// {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] profiler.enabled = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] profiler.es_doc_type = notification {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] profiler.es_scroll_size = 10000 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] profiler.es_scroll_time = 2m {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] profiler.filter_error_trace = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] profiler.hmac_keys = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] profiler.sentinel_service_name = mymaster {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] profiler.socket_timeout = 0.1 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] profiler.trace_requests = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] profiler.trace_sqlalchemy = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] profiler_jaeger.process_tags = {} {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] profiler_jaeger.service_name_prefix = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] profiler_otlp.service_name_prefix = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_policy.enforce_new_defaults = True {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_policy.policy_default_rule = default {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_policy.policy_file = policy.yaml {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_policy.remote_timeout = 60.0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] privsep_osbrick.group = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] privsep_osbrick.helper_command = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] privsep_osbrick.user = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cinder_sys_admin.group = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cinder_sys_admin.helper_command = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] cinder_sys_admin.user = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] service_user.auth_section = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] service_user.auth_type = password {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] service_user.cafile = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] service_user.certfile = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] service_user.collect_timing = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] service_user.insecure = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] service_user.keyfile = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] service_user.send_service_user_token = True {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] service_user.split_loggers = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] service_user.timeout = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] service_user.tls_ciphers = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] service_user.tls_min_version = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] glance.auth_section = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] glance.auth_type = password {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] glance.certfile = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] glance.collect_timing = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] glance.insecure = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] glance.keyfile = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] glance.region_name = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] glance.split_loggers = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] glance.timeout = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] glance.tls_ciphers = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] glance.tls_min_version = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.backend_availability_zone = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.chap_password = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.chap_username = {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.disk_geometry = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.driver_client_cert = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.driver_client_cert_key = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.driver_data_namespace = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.driver_use_ssl = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.enable_unsupported_driver = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.extra_capabilities = {} {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.filter_function = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.goodness_function = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.iscsi_target_flags = {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.iscsi_write_cache = on {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.iser_helper = tgtadm {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.iser_ip_address = 192.168.122.25 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.iser_port = 3260 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.nas_host = {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.nas_login = admin {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.nas_mount_options = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.nas_password = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.nas_private_key = {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.nas_share_path = {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.nas_ssh_port = 22 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.num_shell_tries = 3 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.nvmet_port_id = 1 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.quobyte_client_cfg = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.quobyte_volume_url = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.replication_device = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.report_discard_supported = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.reserved_percentage = 0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.scst_target_driver = iscsi {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.scst_target_iqn_name = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.storage_protocol = iSCSI {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.target_helper = tgtadm {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.target_ip_address = 192.168.122.25 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.target_port = 3260 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.target_protocol = iscsi {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.trace_flags = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.unique_fqdn_network = True {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.use_chap_auth = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.volume_backend_name = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.volume_clear = zero {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.volume_clear_ionice = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.volume_clear_size = 0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_reports.file_event_handler = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_reports.log_dir = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.backend_availability_zone = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.backend_host = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.chap_password = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.chap_username = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.chiscsi_conf = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.disk_geometry = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.driver_client_cert = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.driver_client_cert_key = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.driver_data_namespace = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.driver_use_ssl = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.extra_capabilities = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.filter_function = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.goodness_function = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.iscsi_target_flags = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.iscsi_write_cache = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.iser_helper = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.iser_ip_address = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.iser_port = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.iser_target_prefix = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.nas_host = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.nas_login = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.nas_mount_options = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.nas_password = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.nas_private_key = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.nas_share_path = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.nas_ssh_port = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.num_shell_tries = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.nvmet_ns_id = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.nvmet_port_id = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.replication_device = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.report_discard_supported = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.reserved_percentage = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.scst_target_driver = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.storage_protocol = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.target_helper = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.target_ip_address = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.target_port = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.target_prefix = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.target_protocol = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.trace_flags = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.unique_fqdn_network = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.use_chap_auth = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.volume_clear = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.volume_clear_ionice = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.volume_clear_size = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] QuobyteHD.volumes_dir = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack quobyte-client[86353]: Reading configuration file: /etc/quobyte/client.cfg Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.ssl = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack quobyte-client[86353]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86348]: DEBUG oslo_concurrency.processutils [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] CMD "mount.quobyte" returned: 1 in 0.130s {{(pid=86348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:22:00 devstack cinder-volume[86348]: DEBUG oslo_concurrency.lockutils [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:22:00 devstack cinder-volume[86348]: DEBUG oslo_concurrency.lockutils [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:22:00 devstack cinder-volume[86348]: DEBUG cinder.volume.drivers.quobyte [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=86348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86348]: INFO cinder.volume.drivers.quobyte [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 ... Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.ssl_version = {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86348]: DEBUG oslo_concurrency.processutils [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f -c /etc/quobyte/client-cinder.cfg {{(pid=86348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_notifications.driver = [] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_notifications.retry = -1 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] oslo_messaging_notifications.transport_url = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] key_manager.fixed_key = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican.barbican_api_version = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican.barbican_endpoint = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican.barbican_endpoint_type = public {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican.barbican_region_name = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican.cafile = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican.certfile = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican.collect_timing = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican.insecure = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican.keyfile = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican.number_of_retries = 60 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican.retry_delay = 1 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican.send_service_user_token = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican.split_loggers = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican.timeout = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican.tls_ciphers = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican.tls_min_version = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican.verify_ssl = True {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican.verify_ssl_path = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican_service_user.auth_section = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican_service_user.auth_type = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican_service_user.cafile = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican_service_user.certfile = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican_service_user.collect_timing = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican_service_user.insecure = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican_service_user.keyfile = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican_service_user.split_loggers = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican_service_user.timeout = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican_service_user.tls_ciphers = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] barbican_service_user.tls_min_version = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] vault.approle_role_id = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] vault.approle_secret_id = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] vault.auth_method = approle {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] vault.auth_path = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] vault.kv_mountpoint = secret {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack sudo[86354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f -c /etc/quobyte/client-cinder.cfg Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] vault.kv_path = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack sudo[86354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] vault.kv_version = 2 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] vault.namespace = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] vault.root_token_id = **** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] vault.ssl_ca_crt_file = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] vault.timeout = 60.0 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] vault.token_file = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] vault.token_role = None {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] vault.use_ssl = False {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:00 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] ******************************************************************************** {{(pid=86131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 07:22:00 devstack sudo[86354]: pam_unix(sudo:session): session closed for user root Nov 03 07:22:00 devstack cinder-volume[86348]: DEBUG oslo_concurrency.processutils [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.457s {{(pid=86348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:22:00 devstack cinder-volume[86348]: INFO cinder.volume.drivers.quobyte [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 succeeded Nov 03 07:22:00 devstack cinder-volume[86348]: DEBUG cinder.volume.drivers.quobyte [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=86348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:22:00 devstack cinder-volume[86348]: DEBUG oslo_concurrency.lockutils [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.467s {{(pid=86348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:22:00 devstack cinder-volume[86348]: DEBUG oslo_concurrency.processutils [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=86348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:22:00 devstack sudo[86456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:22:00 devstack sudo[86456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:22:00 devstack sudo[86456]: pam_unix(sudo:session): session closed for user root Nov 03 07:22:00 devstack cinder-volume[86348]: DEBUG oslo_concurrency.processutils [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.247s {{(pid=86348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:22:00 devstack cinder-volume[86348]: INFO cinder.volume.driver [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Driver hasn't implemented _init_vendor_properties() Nov 03 07:22:00 devstack cinder-volume[86348]: DEBUG cinder.volume.driver [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7531204223633, 'free_capacity_gb': 1773.7531204223633, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86348) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 07:22:01 devstack cinder-volume[86348]: DEBUG oslo_db.sqlalchemy.engines [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86348) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:22:01 devstack cinder-volume[86348]: DEBUG dbcounter [-] [86348] Writer thread running {{(pid=86348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 07:22:01 devstack cinder-volume[86348]: DEBUG cinder.db.api [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Building query based on filter {{(pid=86348) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 07:22:01 devstack cinder-volume[86348]: DEBUG cinder.image.image_utils [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86348) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 07:22:01 devstack cinder-volume[86348]: INFO cinder.keymgr.migration [None req-2723b75e-b573-43e9-9ff1-236a35bb4f8a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 07:22:01 devstack cinder-volume[86348]: DEBUG oslo_concurrency.lockutils [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:22:01 devstack cinder-volume[86348]: DEBUG oslo_concurrency.lockutils [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:22:01 devstack cinder-volume[86348]: DEBUG cinder.volume.drivers.quobyte [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=86348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:22:01 devstack cinder-volume[86348]: DEBUG cinder.volume.drivers.quobyte [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=86348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:22:01 devstack cinder-volume[86348]: DEBUG oslo_concurrency.lockutils [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:22:01 devstack cinder-volume[86348]: DEBUG oslo_concurrency.processutils [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=86348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:22:01 devstack sudo[86459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:22:01 devstack sudo[86459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:22:01 devstack sudo[86459]: pam_unix(sudo:session): session closed for user root Nov 03 07:22:01 devstack cinder-volume[86348]: DEBUG oslo_concurrency.processutils [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.260s {{(pid=86348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:22:01 devstack cinder-volume[86348]: DEBUG cinder.manager [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Notifying Schedulers of capabilities ... {{(pid=86348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:22:01 devstack cinder-volume[86348]: INFO cinder.volume.manager [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Driver initialization completed successfully. Nov 03 07:22:01 devstack cinder-volume[86348]: INFO cinder.manager [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Initiating service 3 cleanup Nov 03 07:22:01 devstack cinder-volume[86348]: INFO cinder.manager [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Service 3 cleanup completed. Nov 03 07:22:01 devstack cinder-volume[86348]: DEBUG cinder.service [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Creating RPC server for service cinder-volume {{(pid=86348) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 07:22:01 devstack cinder-volume[86348]: DEBUG cinder.service [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86348) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 07:22:01 devstack cinder-volume[86348]: INFO cinder.volume.manager [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 07:22:01 devstack cinder-volume[86348]: DEBUG oslo_concurrency.lockutils [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:22:01 devstack cinder-volume[86348]: DEBUG oslo_concurrency.lockutils [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:22:01 devstack cinder-volume[86348]: DEBUG cinder.volume.drivers.quobyte [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=86348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:22:01 devstack cinder-volume[86348]: DEBUG cinder.volume.drivers.quobyte [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=86348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:22:01 devstack cinder-volume[86348]: DEBUG oslo_concurrency.lockutils [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:22:01 devstack cinder-volume[86348]: DEBUG oslo_concurrency.processutils [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=86348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:22:01 devstack sudo[86462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:22:01 devstack sudo[86462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:22:01 devstack sudo[86462]: pam_unix(sudo:session): session closed for user root Nov 03 07:22:01 devstack cinder-volume[86348]: DEBUG oslo_concurrency.processutils [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.286s {{(pid=86348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:22:01 devstack cinder-volume[86348]: INFO cinder.volume.manager [None req-73d0032f-fc65-4946-9f73-2d18a8c056ef None None] Driver post RPC initialization completed successfully. Nov 03 07:22:02 devstack cinder-volume[86348]: DEBUG oslo_service.periodic_task [None req-68788605-3702-49c0-a7e6-ff0a5a9cc96a None None] Running periodic task VolumeManager._thread_info {{(pid=86348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:22:02 devstack cinder-volume[86348]: DEBUG cinder.volume.manager [None req-68788605-3702-49c0-a7e6-ff0a5a9cc96a None None] thread count: 6 {{(pid=86348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:22:02 devstack cinder-volume[86348]: DEBUG cinder.volume.manager [None req-68788605-3702-49c0-a7e6-ff0a5a9cc96a None None] thread info: [<_MainThread(MainThread, started 127575006740608)>, , , , , ] {{(pid=86348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:22:06 devstack cinder-volume[86131]: INFO oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Caught SIGTERM, stopping children Nov 03 07:22:06 devstack cinder-volume[86131]: DEBUG oslo_concurrency.lockutils [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Acquiring lock "singleton_lock" {{(pid=86131) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 07:22:06 devstack cinder-volume[86131]: DEBUG oslo_concurrency.lockutils [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Acquired lock "singleton_lock" {{(pid=86131) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 07:22:06 devstack cinder-volume[86131]: DEBUG oslo_concurrency.lockutils [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Releasing lock "singleton_lock" {{(pid=86131) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 07:22:06 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Stop services. {{(pid=86131) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 07:22:06 devstack cinder-volume[86131]: DEBUG oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Killing children. {{(pid=86131) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 07:22:06 devstack cinder-volume[86131]: INFO oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Waiting on 1 children to exit Nov 03 07:22:09 devstack cinder-volume[86348]: DEBUG oslo_concurrency.lockutils [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Acquiring lock "singleton_lock" {{(pid=86348) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 07:22:09 devstack cinder-volume[86348]: DEBUG oslo_concurrency.lockutils [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Acquired lock "singleton_lock" {{(pid=86348) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 07:22:09 devstack cinder-volume[86348]: DEBUG oslo_concurrency.lockutils [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Releasing lock "singleton_lock" {{(pid=86348) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 07:22:09 devstack cinder-volume[86348]: WARNING amqp [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 07:22:09 devstack cinder-volume[86348]: WARNING amqp [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 07:22:09 devstack cinder-volume[86131]: INFO oslo_service.backend._eventlet.service [None req-ab5a2641-2f8e-4b97-a1e2-9a597a6481ab None None] Child 86348 exited with status 0 Nov 03 07:22:10 devstack cinder-volume[86700]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 07:22:10 devstack cinder-volume[86700]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 07:22:10 devstack cinder-volume[86700]: we strongly recommend against using it for new projects. Nov 03 07:22:10 devstack cinder-volume[86700]: If you are already using Eventlet, we recommend migrating to a different Nov 03 07:22:10 devstack cinder-volume[86700]: framework. For more detail see Nov 03 07:22:10 devstack cinder-volume[86700]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 07:22:10 devstack cinder-volume[86700]: import eventlet # noqa Nov 03 07:22:13 devstack cinder-volume[86700]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86700) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 07:22:13 devstack cinder-volume[86700]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86700) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 07:22:13 devstack cinder-volume[86700]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86700) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 07:22:14 devstack cinder-volume[86700]: INFO dbcounter [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] Registered counter for database cinder Nov 03 07:22:14 devstack cinder-volume[86700]: DEBUG oslo_db.sqlalchemy.engines [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86700) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG dbcounter [-] [86700] Writer thread running {{(pid=86700) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 07:22:15 devstack cinder-volume[86700]: INFO cinder.rpc [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 07:22:15 devstack cinder-volume[86700]: INFO cinder.rpc [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_db.sqlalchemy.engines [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86700) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:22:15 devstack cinder-volume[86700]: INFO cinder.volume.manager [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] Determined volume DB was empty at startup. Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG cinder.volume.manager [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86700) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 07:22:15 devstack cinder-volume[86700]: WARNING stevedore.named [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 07:22:15 devstack cinder-volume[86700]: WARNING castellan.key_manager [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 07:22:15 devstack cinder-volume[86700]: WARNING cinder.keymgr.conf_key_mgr [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 07:22:15 devstack cinder-volume[86700]: INFO cinder.volume.manager [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_db.sqlalchemy.engines [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86700) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:22:15 devstack cinder-volume[86700]: INFO oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] Starting 1 workers Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] Started child 87016 {{(pid=86700) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] Full set of CONF: {{(pid=86700) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] ******************************************************************************** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] Configuration options gathered from: {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] ================================================================================ {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] allow_availability_zone_fallback = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] allow_compression_on_image_upload = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] allowed_direct_url_schemes = [] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] api_rate_limit = True {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] auth_strategy = keystone {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_availability_zone = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[87016]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_host = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_name = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_stats_polling_interval = 60 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backup_api_class = cinder.backup.api.API {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backup_name_template = backup-%s {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backup_use_same_host = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backup_use_temp_snapshot = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] chap_password = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] chap_username = {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cinder_internal_tenant_project_id = 46fc814d0ca04c7f8d6d68c25d1793ab {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cinder_internal_tenant_user_id = 266412aac9f948a3849efe0f1ae3aa46 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cluster = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] compression_format = gzip {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] compute_api_class = cinder.compute.nova.API {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] config_dir = [] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] config_source = [] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] control_exchange = openstack {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] debug = True {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] default_availability_zone = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] default_group_type = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] default_volume_type = QuobyteHD {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] disk_geometry = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] driver_client_cert = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] driver_client_cert_key = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] driver_data_namespace = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] driver_ssl_cert_path = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] driver_ssl_cert_verify = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] driver_use_ssl = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] enable_new_services = True {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] enable_unsupported_driver = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] enabled_backends = ['QuobyteHD'] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] enforce_multipath_for_image_xfer = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] filter_function = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] glance_api_insecure = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] glance_api_servers = ['http://192.168.122.25/image'] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] glance_api_ssl_compression = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] glance_ca_certificates_file = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] glance_catalog_info = image:glance:publicURL {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] glance_certfile = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] glance_keyfile = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] glance_num_retries = 3 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] glance_request_timeout = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] goodness_function = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] graceful_shutdown_timeout = 5 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] group_api_class = cinder.group.api.API {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] host = devstack {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] image_compress_on_upload = True {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] image_conversion_address_space_limit = 1 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] image_conversion_cpu_limit = 60 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] image_conversion_disable = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] image_introspection_address_space_limit = 1 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] image_introspection_cpu_limit = 60 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] image_upload_use_cinder_backend = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] image_upload_use_internal_tenant = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] image_volume_cache_enabled = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] image_volume_cache_max_count = 0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] image_volume_cache_max_size_gb = 0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] init_host_max_objects_retrieval = 0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] instance_format = [instance: %(uuid)s] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] iscsi_target_flags = {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] iscsi_write_cache = on {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] iser_helper = tgtadm {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] iser_ip_address = 192.168.122.25 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] iser_port = 3260 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] log_color = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] log_config_append = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] log_dir = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] log_file = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] log_options = True {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] log_rotate_interval = 1 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] log_rotate_interval_type = days {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] log_rotation_type = none {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] max_age = 0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] max_logfile_count = 30 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] max_logfile_size_mb = 200 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] max_over_subscription_ratio = 20.0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] message_reap_interval = 86400 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] message_ttl = 2592000 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] migration_create_volume_timeout_secs = 300 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] monkey_patch = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] monkey_patch_modules = [] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] my_ip = 192.168.122.25 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] no_snapshot_gb_quota = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] num_iser_scan_tries = 3 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] num_shell_tries = 3 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] num_volume_device_scan_tries = 3 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] nvmeof_conn_info_version = 1 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] nvmet_ns_id = 10 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] nvmet_port_id = 1 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] osapi_max_limit = 1000 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] osapi_volume_ext_list = [] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] osapi_volume_listen = 0.0.0.0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] osapi_volume_listen_port = 8776 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] osapi_volume_use_ssl = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] osapi_volume_workers = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] per_volume_size_limit = -1 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] periodic_fuzzy_delay = 60 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] periodic_interval = 60 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] project_id_regex = [0-9a-f\-]+ {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] public_endpoint = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] publish_errors = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] quota_backup_gigabytes = 1000 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] quota_backups = 10 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] quota_gigabytes = 1000 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] quota_groups = 10 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] quota_snapshots = 10 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] quota_volumes = 10 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] rate_limit_burst = 0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] rate_limit_except_level = CRITICAL {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] rate_limit_interval = 0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] reinit_driver_count = 3 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] replication_device = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] report_discard_supported = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] report_interval = 120 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] reservation_clean_interval = 86400 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] reservation_expire = 86400 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] reserved_image_namespaces = [] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] reserved_percentage = 0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] rpc_response_timeout = 120 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] run_external_periodic_tasks = True {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] scst_target_driver = iscsi {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] scst_target_iqn_name = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] service_down_time = 720 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] shell_completion = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] snapshot_name_template = snapshot-%s {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] split_loggers = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] state_path = /opt/stack/data/cinder {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87016) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] storage_availability_zone = nova {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] storage_protocol = iSCSI {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] syslog_log_facility = LOG_USER {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] target_helper = lioadm {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] target_ip_address = 192.168.122.25 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] target_port = 3260 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] target_protocol = iscsi {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] target_secondary_ip_addresses = [] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] trace_flags = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] transfer_api_class = cinder.transfer.api.API {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] transport_url = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] until_refresh = 0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] use_chap_auth = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] use_default_quota_class = True {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] use_journal = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] use_json = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] use_multipath_for_image_xfer = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] use_stderr = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] use_syslog = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] verify_glance_signatures = enabled {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] volume_api_class = cinder.volume.api.API {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] volume_backend_name = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] volume_clear = zero {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] volume_clear_ionice = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] volume_clear_size = 0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] volume_copy_bps_limit = 0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] volume_dd_blocksize = 1M {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] volume_name_template = volume-%s {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] volume_service_inithost_offload = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] volume_usage_audit_period = month {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] zoning_mode = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_concurrency.disable_process_locking = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.auth_section = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.auth_type = password {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.auth_version = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.cache = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.certfile = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.delay_auth_decision = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.http_connect_timeout = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.include_service_catalog = True {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.insecure = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.interface = public {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.keyfile = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.memcache_password = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.memcache_username = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.region_name = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.service_token_roles_required = True {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.service_type = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.token_cache_time = 300 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.25/identity {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.backend = dogpile.cache.null {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.backend_argument = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.backend_expiration_time = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.config_prefix = cache.oslo {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.debug_cache_backend = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.enable_retry_client = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.enable_socket_keepalive = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.enabled = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.expiration_time = 600 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.hashclient_retry_attempts = 2 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.memcache_dead_retry = 300 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.memcache_pool_maxsize = 10 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.memcache_sasl_enabled = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.password = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.proxies = [] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.redis_db = 0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.redis_sentinel_service_name = mymaster {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.redis_server = localhost:6379 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.retry_attempts = 2 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.retry_delay = 0.0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.socket_keepalive_count = 1 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.socket_keepalive_idle = 1 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.socket_keepalive_interval = 1 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.socket_timeout = 1.0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.tls_allowed_ciphers = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.tls_cafile = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.tls_certfile = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.tls_enabled = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.tls_keyfile = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cache.username = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] coordination.backend_url = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] database.asyncio_connection = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] database.asyncio_slave_connection = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] database.backend = sqlalchemy {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] database.connection = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] database.connection_debug = 0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] database.connection_parameters = {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] database.connection_recycle_time = 3600 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] database.connection_trace = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] database.db_inc_retry_interval = True {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] database.db_max_retries = 20 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] database.db_max_retry_interval = 10 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] database.db_retry_interval = 1 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] database.max_overflow = 50 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] database.max_pool_size = 5 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] database.max_retries = 10 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] database.mysql_wsrep_sync_wait = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] database.pool_timeout = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] database.retry_interval = 10 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] database.slave_connection = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] database.sqlite_synchronous = True {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] database.synchronous_reader = True {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] database.use_db_reconnect = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_tracing.insecure = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] profiler.connection_string = messaging:// {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] profiler.enabled = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] profiler.es_doc_type = notification {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] profiler.es_scroll_size = 10000 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] profiler.es_scroll_time = 2m {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] profiler.filter_error_trace = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] profiler.hmac_keys = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] profiler.sentinel_service_name = mymaster {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] profiler.socket_timeout = 0.1 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] profiler.trace_requests = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] profiler.trace_sqlalchemy = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] profiler_jaeger.process_tags = {} {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] profiler_jaeger.service_name_prefix = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] profiler_otlp.service_name_prefix = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_policy.enforce_new_defaults = True {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_policy.policy_default_rule = default {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_policy.policy_file = policy.yaml {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_policy.remote_timeout = 60.0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] privsep_osbrick.group = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] privsep_osbrick.helper_command = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] privsep_osbrick.user = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cinder_sys_admin.group = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cinder_sys_admin.helper_command = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] cinder_sys_admin.user = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] service_user.auth_section = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] service_user.auth_type = password {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] service_user.cafile = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] service_user.certfile = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] service_user.collect_timing = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] service_user.insecure = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] service_user.keyfile = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] service_user.send_service_user_token = True {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] service_user.split_loggers = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] service_user.timeout = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] service_user.tls_ciphers = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] service_user.tls_min_version = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] glance.auth_section = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] glance.auth_type = password {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] glance.certfile = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] glance.collect_timing = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] glance.insecure = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] glance.keyfile = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] glance.region_name = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] glance.split_loggers = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] glance.timeout = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] glance.tls_ciphers = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] glance.tls_min_version = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87016) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 07:22:15 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.quobyte [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 07:22:15 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.quobyte [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.backend_availability_zone = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.chap_password = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Running cmd (subprocess): mount.quobyte {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.chap_username = {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.disk_geometry = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.driver_client_cert = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.driver_client_cert_key = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.driver_data_namespace = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.driver_use_ssl = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.enable_unsupported_driver = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.extra_capabilities = {} {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.filter_function = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.goodness_function = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.iscsi_target_flags = {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.iscsi_write_cache = on {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.iser_helper = tgtadm {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.iser_ip_address = 192.168.122.25 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.iser_port = 3260 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.nas_host = {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.nas_login = admin {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.nas_mount_options = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.nas_password = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.nas_private_key = {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.nas_share_path = {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.nas_ssh_port = 22 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.num_shell_tries = 3 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.nvmet_port_id = 1 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.quobyte_client_cfg = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.quobyte_volume_url = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.replication_device = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.report_discard_supported = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.reserved_percentage = 0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.scst_target_driver = iscsi {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.scst_target_iqn_name = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.storage_protocol = iSCSI {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.target_helper = tgtadm {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.target_ip_address = 192.168.122.25 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.target_port = 3260 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.target_protocol = iscsi {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.trace_flags = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.unique_fqdn_network = True {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.use_chap_auth = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.volume_backend_name = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.volume_clear = zero {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.volume_clear_ionice = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.volume_clear_size = 0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_reports.file_event_handler = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_reports.log_dir = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.backend_availability_zone = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.backend_host = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.chap_password = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.chap_username = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.chiscsi_conf = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.disk_geometry = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.driver_client_cert = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.driver_client_cert_key = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.driver_data_namespace = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.driver_use_ssl = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.extra_capabilities = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.filter_function = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.goodness_function = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.iscsi_target_flags = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.iscsi_write_cache = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.iser_helper = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.iser_ip_address = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.iser_port = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.iser_target_prefix = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.nas_host = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.nas_login = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.nas_mount_options = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.nas_password = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.nas_private_key = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.nas_share_path = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.nas_ssh_port = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.num_shell_tries = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.nvmet_ns_id = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.nvmet_port_id = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.replication_device = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.report_discard_supported = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.reserved_percentage = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.scst_target_driver = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.storage_protocol = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.target_helper = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.target_ip_address = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.target_port = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.target_prefix = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.target_protocol = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.trace_flags = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.unique_fqdn_network = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.use_chap_auth = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.volume_clear = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.volume_clear_ionice = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.volume_clear_size = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] QuobyteHD.volumes_dir = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.ssl = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.ssl_version = {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_notifications.driver = [] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_notifications.retry = -1 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] oslo_messaging_notifications.transport_url = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] key_manager.fixed_key = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican.barbican_api_version = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican.barbican_endpoint = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican.barbican_endpoint_type = public {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican.barbican_region_name = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican.cafile = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican.certfile = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican.collect_timing = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack quobyte-client[87018]: Reading configuration file: /etc/quobyte/client.cfg Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican.insecure = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican.keyfile = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican.number_of_retries = 60 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican.retry_delay = 1 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack quobyte-client[87018]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican.send_service_user_token = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican.split_loggers = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican.timeout = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican.tls_ciphers = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican.tls_min_version = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican.verify_ssl = True {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican.verify_ssl_path = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican_service_user.auth_section = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican_service_user.auth_type = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican_service_user.cafile = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] CMD "mount.quobyte" returned: 1 in 0.112s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican_service_user.certfile = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican_service_user.collect_timing = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican_service_user.insecure = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican_service_user.keyfile = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican_service_user.split_loggers = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican_service_user.timeout = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican_service_user.tls_ciphers = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] barbican_service_user.tls_min_version = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] vault.approle_role_id = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] vault.approle_secret_id = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] vault.auth_method = approle {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] vault.auth_path = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] vault.kv_mountpoint = secret {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] vault.kv_path = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] vault.kv_version = 2 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] vault.namespace = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] vault.root_token_id = **** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] vault.ssl_ca_crt_file = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] vault.timeout = 60.0 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] vault.token_file = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] vault.token_role = None {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] vault.use_ssl = False {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:22:15 devstack cinder-volume[86700]: DEBUG oslo_service.backend._eventlet.service [None req-06de9b11-dddf-4840-bcbf-71a7433cabff None None] ******************************************************************************** {{(pid=86700) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 07:22:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:22:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:22:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:22:15 devstack sudo[87019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:22:15 devstack sudo[87019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:22:16 devstack sudo[87019]: pam_unix(sudo:session): session closed for user root Nov 03 07:22:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.278s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:22:16 devstack cinder-volume[87016]: INFO cinder.volume.driver [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Driver hasn't implemented _init_vendor_properties() Nov 03 07:22:16 devstack cinder-volume[87016]: DEBUG cinder.volume.driver [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7531204223633, 'free_capacity_gb': 1773.7531204223633, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87016) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 07:22:16 devstack cinder-volume[87016]: DEBUG oslo_db.sqlalchemy.engines [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87016) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:22:16 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writer thread running {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 07:22:16 devstack cinder-volume[87016]: DEBUG cinder.db.api [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Building query based on filter {{(pid=87016) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 07:22:16 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87016) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 07:22:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:22:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:22:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:22:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:22:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:22:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:22:16 devstack cinder-volume[87016]: INFO cinder.keymgr.migration [None req-00ee1aa1-fb6e-4113-9969-1a1280c06b28 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 07:22:16 devstack sudo[87030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:22:16 devstack sudo[87030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:22:16 devstack sudo[87030]: pam_unix(sudo:session): session closed for user root Nov 03 07:22:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.292s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:22:16 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:22:16 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Driver initialization completed successfully. Nov 03 07:22:16 devstack cinder-volume[87016]: INFO cinder.manager [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Initiating service 3 cleanup Nov 03 07:22:16 devstack cinder-volume[87016]: INFO cinder.manager [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Service 3 cleanup completed. Nov 03 07:22:16 devstack cinder-volume[87016]: DEBUG cinder.service [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Creating RPC server for service cinder-volume {{(pid=87016) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 07:22:16 devstack cinder-volume[87016]: DEBUG cinder.service [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87016) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 07:22:16 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 07:22:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:22:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:22:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:22:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:22:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:22:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:22:16 devstack sudo[87044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:22:16 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:22:17 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root Nov 03 07:22:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.314s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:22:17 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ec91b502-5064-4616-bdab-e86debb239e1 None None] Driver post RPC initialization completed successfully. Nov 03 07:22:25 devstack cinder-volume[86700]: DEBUG dbcounter [-] [86700] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86700) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:22:26 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:22:27 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=2 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:22:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:22:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 6 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:22:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:23:12 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:23:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Flow 'volume_create_manager' (5ee4a413-2923-4765-8b02-de3d2425c783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:23:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fdbfe84-a0e5-4ca1-9725-072d5ce4b440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fdbfe84-a0e5-4ca1-9725-072d5ce4b440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1025910069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a002c30-ee45-4789-8da8-13923c47e413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf2e12e2ddc246b69253cdde0c53149b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:23:13Z,use_quota=True,user_id='b0edb4fad3e04f5691328e0dac768b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25baa8d8-afa3-4e0a-96b2-d201a31f8c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25baa8d8-afa3-4e0a-96b2-d201a31f8c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eedd0304-80f4-47af-956a-f9c2a93a326f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eedd0304-80f4-47af-956a-f9c2a93a326f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a002c30-ee45-4789-8da8-13923c47e413', 'volume_name': 'volume-1a002c30-ee45-4789-8da8-13923c47e413', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b1fa02-7caa-4de3-8be2-9473755aa1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b1fa02-7caa-4de3-8be2-9473755aa1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21635650-4658-4110-8f23-26b89ed1b1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:12 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Volume 1a002c30-ee45-4789-8da8-13923c47e413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a002c30-ee45-4789-8da8-13923c47e413', 'volume_size': 1} Nov 03 07:23:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:23:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:23:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1025910069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a002c30-ee45-4789-8da8-13923c47e413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf2e12e2ddc246b69253cdde0c53149b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:23:13Z,use_quota=True,user_id='b0edb4fad3e04f5691328e0dac768b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:23:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Creating volume 1a002c30-ee45-4789-8da8-13923c47e413 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:23:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:23:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:23:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:23:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:23:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:23:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:23:12 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:23:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:12 devstack sudo[87365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413 1073741824 Nov 03 07:23:12 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:13 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:23:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Flow 'volume_create_manager' (ffcdf70a-a2fe-4254-8ff5-95930d395861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:23:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10fde61f-3f4c-4c2e-9acc-05c53bd98e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10fde61f-3f4c-4c2e-9acc-05c53bd98e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-611366755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb1374bf-4322-46d4-82f3-807a3dce0a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a81d48e1600c4fbba17c46a269a1f567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:23:13Z,use_quota=True,user_id='1b9fe2a312cf4cf4ab8583c433a19218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af2410b-8fe9-4b30-aa6c-43e4a5b0076b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af2410b-8fe9-4b30-aa6c-43e4a5b0076b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e45f3ac5-eb2c-479c-a2c4-a905b2b8ecff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e45f3ac5-eb2c-479c-a2c4-a905b2b8ecff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb1374bf-4322-46d4-82f3-807a3dce0a1e', 'volume_name': 'volume-cb1374bf-4322-46d4-82f3-807a3dce0a1e', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd185df-d313-4cb7-92f2-0e3ccffa0996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd185df-d313-4cb7-92f2-0e3ccffa0996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f955233-561f-49e7-b04c-bfd57bcc3d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:13 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Volume cb1374bf-4322-46d4-82f3-807a3dce0a1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb1374bf-4322-46d4-82f3-807a3dce0a1e', 'volume_size': 1} Nov 03 07:23:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:23:13 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413 1073741824" returned: 0 in 0.796s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:13 devstack sudo[87692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413 Nov 03 07:23:13 devstack sudo[87692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:14 devstack sudo[87692]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413" returned: 0 in 0.305s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:23:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:23:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.668s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:23:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-611366755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb1374bf-4322-46d4-82f3-807a3dce0a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a81d48e1600c4fbba17c46a269a1f567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:23:13Z,use_quota=True,user_id='1b9fe2a312cf4cf4ab8583c433a19218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:23:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Creating volume cb1374bf-4322-46d4-82f3-807a3dce0a1e {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:23:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:23:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:23:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:23:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:23:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:23:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:23:14 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:23:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cb1374bf-4322-46d4-82f3-807a3dce0a1e 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21635650-4658-4110-8f23-26b89ed1b1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a002c30-ee45-4789-8da8-13923c47e413', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:14 devstack sudo[87697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cb1374bf-4322-46d4-82f3-807a3dce0a1e 1073741824 Nov 03 07:23:14 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43da45bb-2d09-4970-b1f1-9a860bd3e5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:14 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Volume volume-1a002c30-ee45-4789-8da8-13923c47e413 (1a002c30-ee45-4789-8da8-13923c47e413): created successfully Nov 03 07:23:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43da45bb-2d09-4970-b1f1-9a860bd3e5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Flow 'volume_create_manager' (5ee4a413-2923-4765-8b02-de3d2425c783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:23:14 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-c135e74e-4a82-4b67-908b-cb5ae61e44c4 req-c4c97499-a289-4eb1-9f84-57b6e791aec9 tempest-VolumesSnapshotsTestJSON-374936559 None] Created volume successfully. Nov 03 07:23:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-7f3f36f4-f2fb-4ac5-977d-542a3455b572 req-49b1523a-00d0-47d5-b4e0-3c5cbdc86448 tempest-VolumesSnapshotsTestJSON-374936559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:23:14 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cb1374bf-4322-46d4-82f3-807a3dce0a1e 1073741824" returned: 0 in 0.852s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cb1374bf-4322-46d4-82f3-807a3dce0a1e {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:15 devstack sudo[87708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cb1374bf-4322-46d4-82f3-807a3dce0a1e Nov 03 07:23:15 devstack sudo[87708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:15 devstack sudo[87708]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cb1374bf-4322-46d4-82f3-807a3dce0a1e" returned: 0 in 0.417s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:23:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:23:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-7f3f36f4-f2fb-4ac5-977d-542a3455b572 req-49b1523a-00d0-47d5-b4e0-3c5cbdc86448 tempest-VolumesSnapshotsTestJSON-374936559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.601s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:23:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f955233-561f-49e7-b04c-bfd57bcc3d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb1374bf-4322-46d4-82f3-807a3dce0a1e', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120dddf3-2a7c-46f5-a4cd-047e9b8d0459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:15 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Volume volume-cb1374bf-4322-46d4-82f3-807a3dce0a1e (cb1374bf-4322-46d4-82f3-807a3dce0a1e): created successfully Nov 03 07:23:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120dddf3-2a7c-46f5-a4cd-047e9b8d0459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Flow 'volume_create_manager' (ffcdf70a-a2fe-4254-8ff5-95930d395861) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:23:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [req-7f3f36f4-f2fb-4ac5-977d-542a3455b572 req-49b1523a-00d0-47d5-b4e0-3c5cbdc86448 tempest-VolumesSnapshotsTestJSON-374936559 None] Creating offline snapshot 479de860-d1bb-46a6-8b5f-6da09563f637 of volume 1a002c30-ee45-4789-8da8-13923c47e413 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:23:15 devstack cinder-volume[87016]: INFO oslo.privsep.daemon [req-7f3f36f4-f2fb-4ac5-977d-542a3455b572 req-49b1523a-00d0-47d5-b4e0-3c5cbdc86448 tempest-VolumesSnapshotsTestJSON-374936559 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp50a5la9m/privsep.sock'] Nov 03 07:23:15 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-f0b4c317-4ec3-4411-a62d-b0d206f91445 tempest-TaggedAttachmentsTest-1731049176 None] Created volume successfully. Nov 03 07:23:15 devstack sudo[87712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp50a5la9m/privsep.sock Nov 03 07:23:15 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:17 devstack cinder-volume[87016]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 03 07:23:17 devstack cinder-volume[87016]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 07:23:17 devstack cinder-volume[87016]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 03 07:23:17 devstack cinder-volume[87016]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 07:23:17 devstack cinder-volume[87016]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 03 07:23:17 devstack cinder-volume[87016]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 03 07:23:17 devstack cinder-volume[87016]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 07:23:17 devstack cinder-volume[87016]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 07:23:17 devstack cinder-volume[87016]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 03 07:23:17 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:17 devstack cinder-volume[87016]: INFO oslo.privsep.daemon [req-7f3f36f4-f2fb-4ac5-977d-542a3455b572 req-49b1523a-00d0-47d5-b4e0-3c5cbdc86448 tempest-VolumesSnapshotsTestJSON-374936559 None] Spawned new privsep daemon via rootwrap Nov 03 07:23:17 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [req-7f3f36f4-f2fb-4ac5-977d-542a3455b572 req-49b1523a-00d0-47d5-b4e0-3c5cbdc86448 tempest-VolumesSnapshotsTestJSON-374936559 None] Accepted privsep connection to /tmp/tmp50a5la9m/privsep.sock {{(pid=87016) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 03 07:23:17 devstack cinder-volume[87016]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 03 07:23:17 devstack cinder-volume[87016]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 03 07:23:17 devstack cinder-volume[87016]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 03 07:23:17 devstack cinder-volume[87016]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87753 Nov 03 07:23:17 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f542f36-d511-4dda-a20f-368c2a31ba91]: (2,) {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:23:17 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3e3ca4-67b6-4236-866a-7b0bbffc66a0]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:23:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-7f3f36f4-f2fb-4ac5-977d-542a3455b572 req-49b1523a-00d0-47d5-b4e0-3c5cbdc86448 tempest-VolumesSnapshotsTestJSON-374936559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:18 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413 Nov 03 07:23:18 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:18 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-7f3f36f4-f2fb-4ac5-977d-542a3455b572 req-49b1523a-00d0-47d5-b4e0-3c5cbdc86448 tempest-VolumesSnapshotsTestJSON-374936559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413" returned: 0 in 0.819s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-7f3f36f4-f2fb-4ac5-977d-542a3455b572 req-49b1523a-00d0-47d5-b4e0-3c5cbdc86448 tempest-VolumesSnapshotsTestJSON-374936559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.479de860-d1bb-46a6-8b5f-6da09563f637 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:18 devstack sudo[87780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.479de860-d1bb-46a6-8b5f-6da09563f637 1G Nov 03 07:23:18 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:19 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-7f3f36f4-f2fb-4ac5-977d-542a3455b572 req-49b1523a-00d0-47d5-b4e0-3c5cbdc86448 tempest-VolumesSnapshotsTestJSON-374936559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.479de860-d1bb-46a6-8b5f-6da09563f637 1G" returned: 0 in 0.743s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-7f3f36f4-f2fb-4ac5-977d-542a3455b572 req-49b1523a-00d0-47d5-b4e0-3c5cbdc86448 tempest-VolumesSnapshotsTestJSON-374936559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a002c30-ee45-4789-8da8-13923c47e413 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.479de860-d1bb-46a6-8b5f-6da09563f637 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:19 devstack sudo[87796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a002c30-ee45-4789-8da8-13923c47e413 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.479de860-d1bb-46a6-8b5f-6da09563f637 Nov 03 07:23:19 devstack sudo[87796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:19 devstack sudo[87796]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-7f3f36f4-f2fb-4ac5-977d-542a3455b572 req-49b1523a-00d0-47d5-b4e0-3c5cbdc86448 tempest-VolumesSnapshotsTestJSON-374936559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a002c30-ee45-4789-8da8-13923c47e413 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.479de860-d1bb-46a6-8b5f-6da09563f637" returned: 0 in 0.457s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:19 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [req-7f3f36f4-f2fb-4ac5-977d-542a3455b572 req-49b1523a-00d0-47d5-b4e0-3c5cbdc86448 tempest-VolumesSnapshotsTestJSON-374936559 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.479de860-d1bb-46a6-8b5f-6da09563f637 is being set with open permissions: ugo+rw Nov 03 07:23:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-7f3f36f4-f2fb-4ac5-977d-542a3455b572 req-49b1523a-00d0-47d5-b4e0-3c5cbdc86448 tempest-VolumesSnapshotsTestJSON-374936559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.479de860-d1bb-46a6-8b5f-6da09563f637 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:19 devstack sudo[87807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.479de860-d1bb-46a6-8b5f-6da09563f637 Nov 03 07:23:19 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:20 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-7f3f36f4-f2fb-4ac5-977d-542a3455b572 req-49b1523a-00d0-47d5-b4e0-3c5cbdc86448 tempest-VolumesSnapshotsTestJSON-374936559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.479de860-d1bb-46a6-8b5f-6da09563f637" returned: 0 in 0.552s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-7f3f36f4-f2fb-4ac5-977d-542a3455b572 req-49b1523a-00d0-47d5-b4e0-3c5cbdc86448 tempest-VolumesSnapshotsTestJSON-374936559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:20 devstack sudo[87816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.info Nov 03 07:23:20 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:21 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-7f3f36f4-f2fb-4ac5-977d-542a3455b572 req-49b1523a-00d0-47d5-b4e0-3c5cbdc86448 tempest-VolumesSnapshotsTestJSON-374936559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.info" returned: 0 in 0.889s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:21 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [req-7f3f36f4-f2fb-4ac5-977d-542a3455b572 req-49b1523a-00d0-47d5-b4e0-3c5cbdc86448 tempest-VolumesSnapshotsTestJSON-374936559 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.info is being set with open permissions: ugo+rw Nov 03 07:23:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-7f3f36f4-f2fb-4ac5-977d-542a3455b572 req-49b1523a-00d0-47d5-b4e0-3c5cbdc86448 tempest-VolumesSnapshotsTestJSON-374936559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:21 devstack sudo[87824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.info Nov 03 07:23:21 devstack sudo[87824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:21 devstack sudo[87824]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-7f3f36f4-f2fb-4ac5-977d-542a3455b572 req-49b1523a-00d0-47d5-b4e0-3c5cbdc86448 tempest-VolumesSnapshotsTestJSON-374936559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.info" returned: 0 in 0.512s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-7f3f36f4-f2fb-4ac5-977d-542a3455b572 req-49b1523a-00d0-47d5-b4e0-3c5cbdc86448 tempest-VolumesSnapshotsTestJSON-374936559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.547s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:23:22 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-7f3f36f4-f2fb-4ac5-977d-542a3455b572 req-49b1523a-00d0-47d5-b4e0-3c5cbdc86448 tempest-VolumesSnapshotsTestJSON-374936559 None] Create snapshot completed successfully Nov 03 07:23:24 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] Acquiring lock "cinder-479de860-d1bb-46a6-8b5f-6da09563f637-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:23:24 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] Lock "cinder-479de860-d1bb-46a6-8b5f-6da09563f637-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:23:24 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] Acquiring lock "cinder-quobyte-1a002c30-ee45-4789-8da8-13923c47e413" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:23:24 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] Lock "cinder-quobyte-1a002c30-ee45-4789-8da8-13923c47e413" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:23:24 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] Acquiring lock "cinder-quobyte-479de860-d1bb-46a6-8b5f-6da09563f637" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:23:24 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] Lock "cinder-quobyte-479de860-d1bb-46a6-8b5f-6da09563f637" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:23:24 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] Deleting offline snapshot 479de860-d1bb-46a6-8b5f-6da09563f637 of volume 1a002c30-ee45-4789-8da8-13923c47e413 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:23:24 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] snapshot_file for this snap is: volume-1a002c30-ee45-4789-8da8-13923c47e413.479de860-d1bb-46a6-8b5f-6da09563f637 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:23:24 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a5f11f-e8e6-4e02-8314-8bd147ddd7eb]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:23:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.479de860-d1bb-46a6-8b5f-6da09563f637 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:24 devstack sudo[87839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.479de860-d1bb-46a6-8b5f-6da09563f637 Nov 03 07:23:24 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:25 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.479de860-d1bb-46a6-8b5f-6da09563f637" returned: 0 in 0.947s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a002c30-ee45-4789-8da8-13923c47e413(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:23:25 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8f7332-3afd-4cd4-b73c-a626d3f2df7f]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:23:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:25 devstack sudo[87872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413 Nov 03 07:23:25 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:26 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413" returned: 0 in 0.904s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.479de860-d1bb-46a6-8b5f-6da09563f637 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:26 devstack sudo[87893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.479de860-d1bb-46a6-8b5f-6da09563f637 Nov 03 07:23:26 devstack sudo[87893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:27 devstack sudo[87893]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.479de860-d1bb-46a6-8b5f-6da09563f637" returned: 0 in 0.649s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.479de860-d1bb-46a6-8b5f-6da09563f637 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:27 devstack sudo[87910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.479de860-d1bb-46a6-8b5f-6da09563f637 Nov 03 07:23:27 devstack sudo[87910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:27 devstack sudo[87910]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413.479de860-d1bb-46a6-8b5f-6da09563f637" returned: 0 in 0.549s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:27 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] Lock "cinder-quobyte-479de860-d1bb-46a6-8b5f-6da09563f637" released by "_delete_snapshot" :: held 3.366s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:23:27 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] Lock "cinder-quobyte-1a002c30-ee45-4789-8da8-13923c47e413" released by "delete_snapshot" :: held 3.419s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:23:27 devstack cinder-volume[87016]: WARNING cinder.quota [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:23:27 devstack cinder-volume[87016]: WARNING cinder.quota [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:23:27 devstack cinder-volume[87016]: DEBUG cinder.quota [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] Created reservations ['4c7dd1db-e74b-4c27-8316-59b6bb1ac10f', 'a77d6179-afa2-477e-af80-89cd86b001f8', 'de687cf8-049f-40c5-965a-c8574888eff7', '2f6b0ebf-2960-4423-a2f1-0d5523e53753'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:23:28 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] Delete snapshot completed successfully. Nov 03 07:23:28 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-65528c6a-6613-4300-880c-288d8d3b5245 req-0c0d280b-e86d-4813-b69b-0ff4ee5267fa tempest-VolumesSnapshotsTestJSON-374936559 None] Lock "cinder-479de860-d1bb-46a6-8b5f-6da09563f637-delete_snapshot" released by "delete_snapshot" :: held 3.882s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:23:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-bf29ae88-ab44-498b-9057-2e6de00f9a92 req-52dc115f-fed9-4061-aea9-c6ac7e2cf291 tempest-VolumesSnapshotsTestJSON-374936559 None] Acquiring lock "cinder-1a002c30-ee45-4789-8da8-13923c47e413-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:23:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-bf29ae88-ab44-498b-9057-2e6de00f9a92 req-52dc115f-fed9-4061-aea9-c6ac7e2cf291 tempest-VolumesSnapshotsTestJSON-374936559 None] Lock "cinder-1a002c30-ee45-4789-8da8-13923c47e413-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:23:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-bf29ae88-ab44-498b-9057-2e6de00f9a92 req-52dc115f-fed9-4061-aea9-c6ac7e2cf291 tempest-VolumesSnapshotsTestJSON-374936559 None] Acquiring lock "cinder-quobyte-1a002c30-ee45-4789-8da8-13923c47e413" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:23:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-bf29ae88-ab44-498b-9057-2e6de00f9a92 req-52dc115f-fed9-4061-aea9-c6ac7e2cf291 tempest-VolumesSnapshotsTestJSON-374936559 None] Lock "cinder-quobyte-1a002c30-ee45-4789-8da8-13923c47e413" acquired by "delete_volume" :: waited 0.032s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:23:29 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4dca5b-5a9c-4755-bd39-b01ca73a981e]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:23:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-bf29ae88-ab44-498b-9057-2e6de00f9a92 req-52dc115f-fed9-4061-aea9-c6ac7e2cf291 tempest-VolumesSnapshotsTestJSON-374936559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:29 devstack sudo[87949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413 Nov 03 07:23:29 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:30 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-bf29ae88-ab44-498b-9057-2e6de00f9a92 req-52dc115f-fed9-4061-aea9-c6ac7e2cf291 tempest-VolumesSnapshotsTestJSON-374936559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413" returned: 0 in 0.615s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-bf29ae88-ab44-498b-9057-2e6de00f9a92 req-52dc115f-fed9-4061-aea9-c6ac7e2cf291 tempest-VolumesSnapshotsTestJSON-374936559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:30 devstack sudo[87959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413 Nov 03 07:23:30 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:30 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-bf29ae88-ab44-498b-9057-2e6de00f9a92 req-52dc115f-fed9-4061-aea9-c6ac7e2cf291 tempest-VolumesSnapshotsTestJSON-374936559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a002c30-ee45-4789-8da8-13923c47e413" returned: 0 in 0.346s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-bf29ae88-ab44-498b-9057-2e6de00f9a92 req-52dc115f-fed9-4061-aea9-c6ac7e2cf291 tempest-VolumesSnapshotsTestJSON-374936559 None] Lock "cinder-quobyte-1a002c30-ee45-4789-8da8-13923c47e413" released by "delete_volume" :: held 1.126s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:23:30 devstack cinder-volume[87016]: WARNING cinder.quota [req-bf29ae88-ab44-498b-9057-2e6de00f9a92 req-52dc115f-fed9-4061-aea9-c6ac7e2cf291 tempest-VolumesSnapshotsTestJSON-374936559 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:23:30 devstack cinder-volume[87016]: DEBUG cinder.quota [req-bf29ae88-ab44-498b-9057-2e6de00f9a92 req-52dc115f-fed9-4061-aea9-c6ac7e2cf291 tempest-VolumesSnapshotsTestJSON-374936559 None] Created reservations ['d01a6029-dbcc-4d7a-bdd6-a55ea3096eb3', 'd5888928-5a5b-4c9d-bc76-3b0f79e2ee3c', '81de3869-3e2b-4e43-8a56-91da788737b7', '3d5b6d87-dbe7-443e-ab5e-75ac5e212139'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:23:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-bf29ae88-ab44-498b-9057-2e6de00f9a92 req-52dc115f-fed9-4061-aea9-c6ac7e2cf291 tempest-VolumesSnapshotsTestJSON-374936559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:23:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-bf29ae88-ab44-498b-9057-2e6de00f9a92 req-52dc115f-fed9-4061-aea9-c6ac7e2cf291 tempest-VolumesSnapshotsTestJSON-374936559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:23:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [req-bf29ae88-ab44-498b-9057-2e6de00f9a92 req-52dc115f-fed9-4061-aea9-c6ac7e2cf291 tempest-VolumesSnapshotsTestJSON-374936559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:23:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [req-bf29ae88-ab44-498b-9057-2e6de00f9a92 req-52dc115f-fed9-4061-aea9-c6ac7e2cf291 tempest-VolumesSnapshotsTestJSON-374936559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:23:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-bf29ae88-ab44-498b-9057-2e6de00f9a92 req-52dc115f-fed9-4061-aea9-c6ac7e2cf291 tempest-VolumesSnapshotsTestJSON-374936559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:23:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-bf29ae88-ab44-498b-9057-2e6de00f9a92 req-52dc115f-fed9-4061-aea9-c6ac7e2cf291 tempest-VolumesSnapshotsTestJSON-374936559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:30 devstack sudo[87965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:23:30 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:30 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-bf29ae88-ab44-498b-9057-2e6de00f9a92 req-52dc115f-fed9-4061-aea9-c6ac7e2cf291 tempest-VolumesSnapshotsTestJSON-374936559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.339s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:30 devstack cinder-volume[87016]: DEBUG cinder.manager [req-bf29ae88-ab44-498b-9057-2e6de00f9a92 req-52dc115f-fed9-4061-aea9-c6ac7e2cf291 tempest-VolumesSnapshotsTestJSON-374936559 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:23:30 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-bf29ae88-ab44-498b-9057-2e6de00f9a92 req-52dc115f-fed9-4061-aea9-c6ac7e2cf291 tempest-VolumesSnapshotsTestJSON-374936559 None] Deleted volume successfully. Nov 03 07:23:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-bf29ae88-ab44-498b-9057-2e6de00f9a92 req-52dc115f-fed9-4061-aea9-c6ac7e2cf291 tempest-VolumesSnapshotsTestJSON-374936559 None] Lock "cinder-1a002c30-ee45-4789-8da8-13923c47e413-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:23:39 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:23:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Flow 'volume_create_manager' (df7c17b3-2c99-4714-993c-325f95f41ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:23:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dace08e3-a0dd-4f3b-9131-224b39b19695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dace08e3-a0dd-4f3b-9131-224b39b19695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1868052500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88608cbb-5037-44bd-a406-a0c3a2d21e2d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37c6442dcdeb4373a70374e417af2648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:23:40Z,use_quota=True,user_id='7cadffb72e994eba9f39136b7eeeeaef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67676622-5df1-4a2b-984e-9366beaef343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67676622-5df1-4a2b-984e-9366beaef343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e7be0f-6905-4b5c-9d90-9dce566d17fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e7be0f-6905-4b5c-9d90-9dce566d17fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88608cbb-5037-44bd-a406-a0c3a2d21e2d', 'volume_name': 'volume-88608cbb-5037-44bd-a406-a0c3a2d21e2d', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (030ebc0f-734c-4dc0-ab47-4981bcbdd834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (030ebc0f-734c-4dc0-ab47-4981bcbdd834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97bee3f6-c1cb-4f31-a860-26209af74eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:39 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Volume 88608cbb-5037-44bd-a406-a0c3a2d21e2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88608cbb-5037-44bd-a406-a0c3a2d21e2d', 'volume_size': 1} Nov 03 07:23:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:23:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:23:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1868052500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88608cbb-5037-44bd-a406-a0c3a2d21e2d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37c6442dcdeb4373a70374e417af2648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:23:40Z,use_quota=True,user_id='7cadffb72e994eba9f39136b7eeeeaef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:23:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Creating volume 88608cbb-5037-44bd-a406-a0c3a2d21e2d {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:23:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:23:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:23:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:23:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:23:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:23:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:23:39 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:23:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-88608cbb-5037-44bd-a406-a0c3a2d21e2d 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:39 devstack sudo[88089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-88608cbb-5037-44bd-a406-a0c3a2d21e2d 1073741824 Nov 03 07:23:39 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:40 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-88608cbb-5037-44bd-a406-a0c3a2d21e2d 1073741824" returned: 0 in 0.703s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-88608cbb-5037-44bd-a406-a0c3a2d21e2d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:40 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-88608cbb-5037-44bd-a406-a0c3a2d21e2d Nov 03 07:23:40 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:41 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-88608cbb-5037-44bd-a406-a0c3a2d21e2d" returned: 0 in 0.304s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:41 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:23:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:23:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97bee3f6-c1cb-4f31-a860-26209af74eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88608cbb-5037-44bd-a406-a0c3a2d21e2d', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3dca26-9fad-47ac-a64a-0394ba39c1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:41 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Volume volume-88608cbb-5037-44bd-a406-a0c3a2d21e2d (88608cbb-5037-44bd-a406-a0c3a2d21e2d): created successfully Nov 03 07:23:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3dca26-9fad-47ac-a64a-0394ba39c1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Flow 'volume_create_manager' (df7c17b3-2c99-4714-993c-325f95f41ac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:23:41 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-a3d7c490-67c1-4708-ac3a-55094ec234da req-ed55a408-2619-46c1-b434-2a12ec4eb9bd tempest-VolumesGetTestJSON-1334549259 None] Created volume successfully. Nov 03 07:23:42 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-f0cdc463-403c-4046-88c0-0674e0f7e78f req-b36c295b-9477-4532-83f0-c7eb4543e8a4 tempest-VolumesGetTestJSON-1334549259 None] Acquiring lock "cinder-88608cbb-5037-44bd-a406-a0c3a2d21e2d-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:23:42 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-f0cdc463-403c-4046-88c0-0674e0f7e78f req-b36c295b-9477-4532-83f0-c7eb4543e8a4 tempest-VolumesGetTestJSON-1334549259 None] Lock "cinder-88608cbb-5037-44bd-a406-a0c3a2d21e2d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:23:42 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-f0cdc463-403c-4046-88c0-0674e0f7e78f req-b36c295b-9477-4532-83f0-c7eb4543e8a4 tempest-VolumesGetTestJSON-1334549259 None] Acquiring lock "cinder-quobyte-88608cbb-5037-44bd-a406-a0c3a2d21e2d" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:23:42 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-f0cdc463-403c-4046-88c0-0674e0f7e78f req-b36c295b-9477-4532-83f0-c7eb4543e8a4 tempest-VolumesGetTestJSON-1334549259 None] Lock "cinder-quobyte-88608cbb-5037-44bd-a406-a0c3a2d21e2d" acquired by "delete_volume" :: waited 0.036s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:23:42 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab714d3-1405-45ef-bf13-9fcef14fb47e]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:23:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-f0cdc463-403c-4046-88c0-0674e0f7e78f req-b36c295b-9477-4532-83f0-c7eb4543e8a4 tempest-VolumesGetTestJSON-1334549259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-88608cbb-5037-44bd-a406-a0c3a2d21e2d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:42 devstack sudo[88101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-88608cbb-5037-44bd-a406-a0c3a2d21e2d Nov 03 07:23:42 devstack sudo[88101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:43 devstack sudo[88101]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-f0cdc463-403c-4046-88c0-0674e0f7e78f req-b36c295b-9477-4532-83f0-c7eb4543e8a4 tempest-VolumesGetTestJSON-1334549259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-88608cbb-5037-44bd-a406-a0c3a2d21e2d" returned: 0 in 0.604s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-f0cdc463-403c-4046-88c0-0674e0f7e78f req-b36c295b-9477-4532-83f0-c7eb4543e8a4 tempest-VolumesGetTestJSON-1334549259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-88608cbb-5037-44bd-a406-a0c3a2d21e2d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:43 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-88608cbb-5037-44bd-a406-a0c3a2d21e2d Nov 03 07:23:43 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:43 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-f0cdc463-403c-4046-88c0-0674e0f7e78f req-b36c295b-9477-4532-83f0-c7eb4543e8a4 tempest-VolumesGetTestJSON-1334549259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-88608cbb-5037-44bd-a406-a0c3a2d21e2d" returned: 0 in 0.361s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-f0cdc463-403c-4046-88c0-0674e0f7e78f req-b36c295b-9477-4532-83f0-c7eb4543e8a4 tempest-VolumesGetTestJSON-1334549259 None] Lock "cinder-quobyte-88608cbb-5037-44bd-a406-a0c3a2d21e2d" released by "delete_volume" :: held 1.044s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:23:43 devstack cinder-volume[87016]: DEBUG cinder.quota [req-f0cdc463-403c-4046-88c0-0674e0f7e78f req-b36c295b-9477-4532-83f0-c7eb4543e8a4 tempest-VolumesGetTestJSON-1334549259 None] Created reservations ['35d0a3fa-1751-4e35-acd1-fe81d9b64dce', '0de53015-91e1-4001-8e5d-e5df37839733', '73634db3-8038-4cf4-84af-019857eca516', 'b448525b-c4e0-4f34-9785-df8ceed235fd'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:23:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-f0cdc463-403c-4046-88c0-0674e0f7e78f req-b36c295b-9477-4532-83f0-c7eb4543e8a4 tempest-VolumesGetTestJSON-1334549259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:23:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-f0cdc463-403c-4046-88c0-0674e0f7e78f req-b36c295b-9477-4532-83f0-c7eb4543e8a4 tempest-VolumesGetTestJSON-1334549259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:23:43 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [req-f0cdc463-403c-4046-88c0-0674e0f7e78f req-b36c295b-9477-4532-83f0-c7eb4543e8a4 tempest-VolumesGetTestJSON-1334549259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:23:43 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [req-f0cdc463-403c-4046-88c0-0674e0f7e78f req-b36c295b-9477-4532-83f0-c7eb4543e8a4 tempest-VolumesGetTestJSON-1334549259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:23:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-f0cdc463-403c-4046-88c0-0674e0f7e78f req-b36c295b-9477-4532-83f0-c7eb4543e8a4 tempest-VolumesGetTestJSON-1334549259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:23:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-f0cdc463-403c-4046-88c0-0674e0f7e78f req-b36c295b-9477-4532-83f0-c7eb4543e8a4 tempest-VolumesGetTestJSON-1334549259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:44 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:23:44 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:44 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-f0cdc463-403c-4046-88c0-0674e0f7e78f req-b36c295b-9477-4532-83f0-c7eb4543e8a4 tempest-VolumesGetTestJSON-1334549259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.475s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:44 devstack cinder-volume[87016]: DEBUG cinder.manager [req-f0cdc463-403c-4046-88c0-0674e0f7e78f req-b36c295b-9477-4532-83f0-c7eb4543e8a4 tempest-VolumesGetTestJSON-1334549259 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:23:44 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-f0cdc463-403c-4046-88c0-0674e0f7e78f req-b36c295b-9477-4532-83f0-c7eb4543e8a4 tempest-VolumesGetTestJSON-1334549259 None] Deleted volume successfully. Nov 03 07:23:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-f0cdc463-403c-4046-88c0-0674e0f7e78f req-b36c295b-9477-4532-83f0-c7eb4543e8a4 tempest-VolumesGetTestJSON-1334549259 None] Lock "cinder-88608cbb-5037-44bd-a406-a0c3a2d21e2d-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:49 devstack sudo[88121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:23:49 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:49 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.558s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 8 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Flow 'volume_create_manager' (f503ae6f-678d-4a25-85ff-e06762f263fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3b6813-8474-4f1f-984a-118d506539e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3b6813-8474-4f1f-984a-118d506539e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-397494079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fda04c13e28c4d42be2069e1025f2e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:23:50Z,use_quota=True,user_id='d3d9db9cd307427fb8b472a1c627b54c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58e73fd-7e7c-4676-8cba-ca45cf0ebce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58e73fd-7e7c-4676-8cba-ca45cf0ebce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3b5205-4983-4c08-bc4d-7dd6f337eb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3b5205-4983-4c08-bc4d-7dd6f337eb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f', 'volume_name': 'volume-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70949fbd-8df4-44f9-8f0f-0075c3f7d5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70949fbd-8df4-44f9-8f0f-0075c3f7d5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cd7966-915d-4513-8a93-c8fd6e10c469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:49 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Volume 7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f', 'volume_size': 1} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-397494079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fda04c13e28c4d42be2069e1025f2e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:23:50Z,use_quota=True,user_id='d3d9db9cd307427fb8b472a1c627b54c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Creating volume 7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:23:49 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:23:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:49 devstack sudo[88124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f 1073741824 Nov 03 07:23:49 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:50 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f 1073741824" returned: 0 in 0.986s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:51 devstack sudo[88130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f Nov 03 07:23:51 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:51 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f" returned: 0 in 0.487s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:23:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:23:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cd7966-915d-4513-8a93-c8fd6e10c469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee6264f-fbc6-42d6-8251-5be1fa7a3ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:23:51 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Volume volume-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f (7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f): created successfully Nov 03 07:23:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee6264f-fbc6-42d6-8251-5be1fa7a3ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:23:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Flow 'volume_create_manager' (f503ae6f-678d-4a25-85ff-e06762f263fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:23:51 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-80a16c72-5b49-4c48-ba8d-6247d3be0194 tempest-ServerActionsTestOtherA-1421339689 None] Created volume successfully. Nov 03 07:24:01 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=30,cinder:UPDATE=32,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:24:01 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=24,cinder:UPDATE=38,cinder:DELETE=5,cinder:INSERT=8 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:24:10 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:24:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Flow 'volume_create_manager' (09d1baff-222b-411c-8eb3-906acb67d21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:24:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff0dedb-7238-48dd-b447-dd9ff9d237be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:24:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff0dedb-7238-48dd-b447-dd9ff9d237be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1218436953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='064a3fc5673a4f3f8e03a243d53167e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:24:10Z,use_quota=True,user_id='eaf72dd016e84ecea52dab819c00cc0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:24:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc6f996-869b-4685-88dc-47decb540894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:24:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc6f996-869b-4685-88dc-47decb540894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:24:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80a6399-1166-4771-9da2-a6a8b4424568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:24:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80a6399-1166-4771-9da2-a6a8b4424568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5', 'volume_name': 'volume-c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:24:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad765875-937a-488a-a55e-265a26134e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:24:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad765875-937a-488a-a55e-265a26134e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:24:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1030803b-703e-4e78-9098-9c38e2a5e57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:24:10 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Volume c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5', 'volume_size': 1} Nov 03 07:24:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:24:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:24:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1218436953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='064a3fc5673a4f3f8e03a243d53167e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:24:10Z,use_quota=True,user_id='eaf72dd016e84ecea52dab819c00cc0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:24:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Creating volume c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:24:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:24:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:24:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:24:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:24:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:24:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:24:10 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:24:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:24:10 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5 1073741824 Nov 03 07:24:10 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:24:11 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Nov 03 07:24:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5 1073741824" returned: 0 in 0.945s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:24:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:24:11 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5 Nov 03 07:24:11 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:24:12 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Nov 03 07:24:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5" returned: 0 in 0.405s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:24:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:24:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:24:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1030803b-703e-4e78-9098-9c38e2a5e57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:24:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c9be65-c8fd-4555-a66f-3fe9d93271c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:24:12 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Volume volume-c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5 (c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5): created successfully Nov 03 07:24:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c9be65-c8fd-4555-a66f-3fe9d93271c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:24:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Flow 'volume_create_manager' (09d1baff-222b-411c-8eb3-906acb67d21d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:24:12 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-8a4a15fd-40ad-41f6-b322-5d0dd6297561 tempest-VolumeQuotasNegativeTestJSON-860619882 None] Created volume successfully. Nov 03 07:24:16 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c1785edd-629e-4e35-9d94-4bd76ff6e69c tempest-VolumeQuotasNegativeTestJSON-860619882 None] Acquiring lock "cinder-c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:24:16 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c1785edd-629e-4e35-9d94-4bd76ff6e69c tempest-VolumeQuotasNegativeTestJSON-860619882 None] Lock "cinder-c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:24:16 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c1785edd-629e-4e35-9d94-4bd76ff6e69c tempest-VolumeQuotasNegativeTestJSON-860619882 None] Acquiring lock "cinder-quobyte-c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:24:16 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c1785edd-629e-4e35-9d94-4bd76ff6e69c tempest-VolumeQuotasNegativeTestJSON-860619882 None] Lock "cinder-quobyte-c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5" acquired by "delete_volume" :: waited 0.052s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:24:16 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b7e922-2e5b-4801-8d5c-a2b485f3ca69]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:24:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1785edd-629e-4e35-9d94-4bd76ff6e69c tempest-VolumeQuotasNegativeTestJSON-860619882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:24:16 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5 Nov 03 07:24:16 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:24:17 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Nov 03 07:24:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1785edd-629e-4e35-9d94-4bd76ff6e69c tempest-VolumeQuotasNegativeTestJSON-860619882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5" returned: 0 in 0.805s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:24:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1785edd-629e-4e35-9d94-4bd76ff6e69c tempest-VolumeQuotasNegativeTestJSON-860619882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:24:17 devstack sudo[88371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5 Nov 03 07:24:17 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:24:17 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root Nov 03 07:24:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1785edd-629e-4e35-9d94-4bd76ff6e69c tempest-VolumeQuotasNegativeTestJSON-860619882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5" returned: 0 in 0.567s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:24:17 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c1785edd-629e-4e35-9d94-4bd76ff6e69c tempest-VolumeQuotasNegativeTestJSON-860619882 None] Lock "cinder-quobyte-c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5" released by "delete_volume" :: held 1.486s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:24:17 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-c1785edd-629e-4e35-9d94-4bd76ff6e69c tempest-VolumeQuotasNegativeTestJSON-860619882 None] Created reservations ['8feebdbb-3bd9-483e-91d5-8930d853b18e', '77750b8d-a791-49b5-bc3d-a4ba454e9957', '78cb876b-403a-4c08-b5ea-eef76647e8e5', '40fd2a4a-9014-44eb-94d1-c98482ce8981'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:24:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c1785edd-629e-4e35-9d94-4bd76ff6e69c tempest-VolumeQuotasNegativeTestJSON-860619882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:24:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c1785edd-629e-4e35-9d94-4bd76ff6e69c tempest-VolumeQuotasNegativeTestJSON-860619882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:24:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-c1785edd-629e-4e35-9d94-4bd76ff6e69c tempest-VolumeQuotasNegativeTestJSON-860619882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:24:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-c1785edd-629e-4e35-9d94-4bd76ff6e69c tempest-VolumeQuotasNegativeTestJSON-860619882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:24:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c1785edd-629e-4e35-9d94-4bd76ff6e69c tempest-VolumeQuotasNegativeTestJSON-860619882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:24:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1785edd-629e-4e35-9d94-4bd76ff6e69c tempest-VolumeQuotasNegativeTestJSON-860619882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:24:18 devstack sudo[88381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:24:18 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:24:18 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root Nov 03 07:24:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1785edd-629e-4e35-9d94-4bd76ff6e69c tempest-VolumeQuotasNegativeTestJSON-860619882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.386s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:24:18 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-c1785edd-629e-4e35-9d94-4bd76ff6e69c tempest-VolumeQuotasNegativeTestJSON-860619882 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:24:18 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-c1785edd-629e-4e35-9d94-4bd76ff6e69c tempest-VolumeQuotasNegativeTestJSON-860619882 None] Deleted volume successfully. Nov 03 07:24:18 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c1785edd-629e-4e35-9d94-4bd76ff6e69c tempest-VolumeQuotasNegativeTestJSON-860619882 None] Lock "cinder-c7ed8753-0d40-4a07-8324-ba4f3dcbe7f5-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:24:20 devstack cinder-volume[87016]: WARNING py.warnings [req-798dbaac-6267-4f1f-ac4b-3501e32dc3c0 req-b528b837-3e21-4583-a6f5-88cef2d379f1 tempest-TaggedAttachmentsTest-1731049176 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Nov 03 07:24:20 devstack cinder-volume[87016]: .first() Nov 03 07:24:20 devstack cinder-volume[87016]: Nov 03 07:24:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-798dbaac-6267-4f1f-ac4b-3501e32dc3c0 req-b528b837-3e21-4583-a6f5-88cef2d379f1 tempest-TaggedAttachmentsTest-1731049176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:24:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-798dbaac-6267-4f1f-ac4b-3501e32dc3c0 req-b528b837-3e21-4583-a6f5-88cef2d379f1 tempest-TaggedAttachmentsTest-1731049176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:24:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-798dbaac-6267-4f1f-ac4b-3501e32dc3c0 req-b528b837-3e21-4583-a6f5-88cef2d379f1 tempest-TaggedAttachmentsTest-1731049176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:24:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-798dbaac-6267-4f1f-ac4b-3501e32dc3c0 req-b528b837-3e21-4583-a6f5-88cef2d379f1 tempest-TaggedAttachmentsTest-1731049176 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14', 'name': 'volume-cb1374bf-4322-46d4-82f3-807a3dce0a1e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5fab4b0e-0212-43f8-8c11-6a515971a816', 'enforce_multipath': True} {{(pid=87016) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:24:21 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-798dbaac-6267-4f1f-ac4b-3501e32dc3c0 req-b528b837-3e21-4583-a6f5-88cef2d379f1 tempest-TaggedAttachmentsTest-1731049176 None] attachment_update completed successfully. Nov 03 07:24:26 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-1a13754c-0f46-45a6-8104-4b2948110f8e req-948bebd0-3c57-48db-9880-5106686d3651 tempest-TaggedAttachmentsTest-1731049176 None] Terminate volume connection completed successfully. Nov 03 07:24:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-1a13754c-0f46-45a6-8104-4b2948110f8e req-948bebd0-3c57-48db-9880-5106686d3651 tempest-TaggedAttachmentsTest-1731049176 None] Deleting attachment 5fab4b0e-0212-43f8-8c11-6a515971a816. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:24:31 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:UPDATE=14,cinder:SELECT=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:24:36 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=20,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:24:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-c5d70780-54a8-44a2-a8b7-339ead74618c req-5245cfe2-879e-4056-a12a-e4bca59efb08 tempest-ServerActionsTestOtherA-1421339689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:24:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-c5d70780-54a8-44a2-a8b7-339ead74618c req-5245cfe2-879e-4056-a12a-e4bca59efb08 tempest-ServerActionsTestOtherA-1421339689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:24:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-c5d70780-54a8-44a2-a8b7-339ead74618c req-5245cfe2-879e-4056-a12a-e4bca59efb08 tempest-ServerActionsTestOtherA-1421339689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:24:38 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-c5d70780-54a8-44a2-a8b7-339ead74618c req-5245cfe2-879e-4056-a12a-e4bca59efb08 tempest-ServerActionsTestOtherA-1421339689 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14', 'name': 'volume-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4fa66079-520f-4634-8d52-73785e0078b9', 'enforce_multipath': True} {{(pid=87016) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:24:38 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-c5d70780-54a8-44a2-a8b7-339ead74618c req-5245cfe2-879e-4056-a12a-e4bca59efb08 tempest-ServerActionsTestOtherA-1421339689 None] attachment_update completed successfully. Nov 03 07:24:42 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2f29baf0-b9f8-4bba-bef1-3d1eb3782a53 tempest-TaggedAttachmentsTest-1731049176 None] Acquiring lock "cinder-cb1374bf-4322-46d4-82f3-807a3dce0a1e-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:24:42 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2f29baf0-b9f8-4bba-bef1-3d1eb3782a53 tempest-TaggedAttachmentsTest-1731049176 None] Lock "cinder-cb1374bf-4322-46d4-82f3-807a3dce0a1e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:24:42 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2f29baf0-b9f8-4bba-bef1-3d1eb3782a53 tempest-TaggedAttachmentsTest-1731049176 None] Acquiring lock "cinder-quobyte-cb1374bf-4322-46d4-82f3-807a3dce0a1e" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:24:42 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2f29baf0-b9f8-4bba-bef1-3d1eb3782a53 tempest-TaggedAttachmentsTest-1731049176 None] Lock "cinder-quobyte-cb1374bf-4322-46d4-82f3-807a3dce0a1e" acquired by "delete_volume" :: waited 0.026s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:24:43 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42b4504-07a3-47ea-af75-5a46584e0096]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:24:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2f29baf0-b9f8-4bba-bef1-3d1eb3782a53 tempest-TaggedAttachmentsTest-1731049176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cb1374bf-4322-46d4-82f3-807a3dce0a1e {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:24:43 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cb1374bf-4322-46d4-82f3-807a3dce0a1e Nov 03 07:24:43 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:24:43 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Nov 03 07:24:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2f29baf0-b9f8-4bba-bef1-3d1eb3782a53 tempest-TaggedAttachmentsTest-1731049176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cb1374bf-4322-46d4-82f3-807a3dce0a1e" returned: 0 in 0.609s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:24:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2f29baf0-b9f8-4bba-bef1-3d1eb3782a53 tempest-TaggedAttachmentsTest-1731049176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cb1374bf-4322-46d4-82f3-807a3dce0a1e {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:24:43 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cb1374bf-4322-46d4-82f3-807a3dce0a1e Nov 03 07:24:43 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:24:43 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-8fa985d3-9f7c-40c4-ae7d-385e14a59be4 req-a4fb6c96-c4b5-4861-b6ab-0957cf172b79 tempest-ServerActionsTestOtherA-1421339689 None] Terminate volume connection completed successfully. Nov 03 07:24:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-8fa985d3-9f7c-40c4-ae7d-385e14a59be4 req-a4fb6c96-c4b5-4861-b6ab-0957cf172b79 tempest-ServerActionsTestOtherA-1421339689 None] Deleting attachment 4fa66079-520f-4634-8d52-73785e0078b9. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:24:44 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Nov 03 07:24:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2f29baf0-b9f8-4bba-bef1-3d1eb3782a53 tempest-TaggedAttachmentsTest-1731049176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cb1374bf-4322-46d4-82f3-807a3dce0a1e" returned: 0 in 0.411s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:24:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2f29baf0-b9f8-4bba-bef1-3d1eb3782a53 tempest-TaggedAttachmentsTest-1731049176 None] Lock "cinder-quobyte-cb1374bf-4322-46d4-82f3-807a3dce0a1e" released by "delete_volume" :: held 1.132s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:24:44 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-2f29baf0-b9f8-4bba-bef1-3d1eb3782a53 tempest-TaggedAttachmentsTest-1731049176 None] Created reservations ['c2504cec-86d0-4368-a22c-631d798b6b2b', '693ea8c0-1f9d-4736-9a60-aecf6cc3ddf6', 'd736d778-06ff-4788-b04b-89ef0bd67770', '781edfca-35d1-4426-ae70-e8c0e5dadd1a'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:24:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2f29baf0-b9f8-4bba-bef1-3d1eb3782a53 tempest-TaggedAttachmentsTest-1731049176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:24:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2f29baf0-b9f8-4bba-bef1-3d1eb3782a53 tempest-TaggedAttachmentsTest-1731049176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:24:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2f29baf0-b9f8-4bba-bef1-3d1eb3782a53 tempest-TaggedAttachmentsTest-1731049176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:24:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2f29baf0-b9f8-4bba-bef1-3d1eb3782a53 tempest-TaggedAttachmentsTest-1731049176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:24:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2f29baf0-b9f8-4bba-bef1-3d1eb3782a53 tempest-TaggedAttachmentsTest-1731049176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:24:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2f29baf0-b9f8-4bba-bef1-3d1eb3782a53 tempest-TaggedAttachmentsTest-1731049176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:24:44 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:24:44 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:24:45 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Nov 03 07:24:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2f29baf0-b9f8-4bba-bef1-3d1eb3782a53 tempest-TaggedAttachmentsTest-1731049176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.612s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:24:45 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-2f29baf0-b9f8-4bba-bef1-3d1eb3782a53 tempest-TaggedAttachmentsTest-1731049176 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:24:45 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-2f29baf0-b9f8-4bba-bef1-3d1eb3782a53 tempest-TaggedAttachmentsTest-1731049176 None] Deleted volume successfully. Nov 03 07:24:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2f29baf0-b9f8-4bba-bef1-3d1eb3782a53 tempest-TaggedAttachmentsTest-1731049176 None] Lock "cinder-cb1374bf-4322-46d4-82f3-807a3dce0a1e-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:24:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-8fa985d3-9f7c-40c4-ae7d-385e14a59be4 req-dbde63af-8c93-420b-ba7f-86575c6e59de tempest-ServerActionsTestOtherA-1421339689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:24:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-8fa985d3-9f7c-40c4-ae7d-385e14a59be4 req-dbde63af-8c93-420b-ba7f-86575c6e59de tempest-ServerActionsTestOtherA-1421339689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:24:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-8fa985d3-9f7c-40c4-ae7d-385e14a59be4 req-dbde63af-8c93-420b-ba7f-86575c6e59de tempest-ServerActionsTestOtherA-1421339689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:24:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-8fa985d3-9f7c-40c4-ae7d-385e14a59be4 req-dbde63af-8c93-420b-ba7f-86575c6e59de tempest-ServerActionsTestOtherA-1421339689 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14', 'name': 'volume-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '19dda318-0195-4293-91ab-bb482df6851b', 'enforce_multipath': True} {{(pid=87016) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:24:45 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-8fa985d3-9f7c-40c4-ae7d-385e14a59be4 req-dbde63af-8c93-420b-ba7f-86575c6e59de tempest-ServerActionsTestOtherA-1421339689 None] attachment_update completed successfully. Nov 03 07:24:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:24:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:24:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:24:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:24:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:24:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:24:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:24:49 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:24:49 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:24:49 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Nov 03 07:24:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.479s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:24:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:24:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:24:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 8 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:24:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:24:55 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=19,cinder:UPDATE=12,cinder:INSERT=3 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:24:55 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=19,cinder:UPDATE=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:25:08 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:25:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Flow 'volume_create_manager' (63ea1391-2348-429d-9162-df8c7353dc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:25:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70739232-f8ab-4c1f-a90a-76f1d2eea7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70739232-f8ab-4c1f-a90a-76f1d2eea7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-291750307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc7b8946-8c70-4534-b9ff-786c2a1dcfb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad30beebe96d488aaf22e85bc1fa2fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:25:09Z,use_quota=True,user_id='e2e4fa56f1744d7abaa1cd38eb8b7e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f547d8f2-204c-4edc-a578-1f4707ea0c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f547d8f2-204c-4edc-a578-1f4707ea0c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed722439-ae67-475d-a9f7-c4c902387074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed722439-ae67-475d-a9f7-c4c902387074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc7b8946-8c70-4534-b9ff-786c2a1dcfb7', 'volume_name': 'volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228ab2fe-b6f9-4055-a298-2a867ee9b186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228ab2fe-b6f9-4055-a298-2a867ee9b186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e072fe89-9566-421b-b3a1-d01bf0db3844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:08 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Volume cc7b8946-8c70-4534-b9ff-786c2a1dcfb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7', 'volume_size': 1} Nov 03 07:25:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:25:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:25:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-291750307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc7b8946-8c70-4534-b9ff-786c2a1dcfb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad30beebe96d488aaf22e85bc1fa2fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:25:09Z,use_quota=True,user_id='e2e4fa56f1744d7abaa1cd38eb8b7e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:25:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Creating volume cc7b8946-8c70-4534-b9ff-786c2a1dcfb7 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:25:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:25:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:25:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:25:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:25:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:25:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:25:08 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:25:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:09 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7 1073741824 Nov 03 07:25:09 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:09 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7 1073741824" returned: 0 in 0.804s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:09 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:25:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Flow 'volume_create_manager' (b7c439b0-02ab-403b-8979-fcfb3951e63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:25:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828f8b84-ce66-4d77-8a16-872dbad645ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828f8b84-ce66-4d77-8a16-872dbad645ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-717123426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e4614a-c975-470f-981f-5a77366b495b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='362fc43b9eee4d59af85ba768d02500a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:25:10Z,use_quota=True,user_id='923cd1cc2561441096b9ff1964862775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9245be4c-04d9-4715-bc2c-6f6e73c48ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9245be4c-04d9-4715-bc2c-6f6e73c48ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3911c3eb-4db1-4307-9a77-a6f111dcce0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3911c3eb-4db1-4307-9a77-a6f111dcce0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50e4614a-c975-470f-981f-5a77366b495b', 'volume_name': 'volume-50e4614a-c975-470f-981f-5a77366b495b', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1baffde6-bd95-405c-941f-ce7aaa2bc99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1baffde6-bd95-405c-941f-ce7aaa2bc99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:09 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7 Nov 03 07:25:09 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b21f353-553a-4546-b55a-36965d400a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:10 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Volume 50e4614a-c975-470f-981f-5a77366b495b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50e4614a-c975-470f-981f-5a77366b495b', 'volume_size': 1} Nov 03 07:25:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:25:10 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7" returned: 0 in 0.414s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:25:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:25:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.368s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:25:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-717123426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e4614a-c975-470f-981f-5a77366b495b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='362fc43b9eee4d59af85ba768d02500a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:25:10Z,use_quota=True,user_id='923cd1cc2561441096b9ff1964862775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:25:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Creating volume 50e4614a-c975-470f-981f-5a77366b495b {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:25:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:25:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:25:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:25:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:25:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:25:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:25:10 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:25:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50e4614a-c975-470f-981f-5a77366b495b 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e072fe89-9566-421b-b3a1-d01bf0db3844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f87cd0-0967-4e29-9754-44edcddb0e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:10 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50e4614a-c975-470f-981f-5a77366b495b 1073741824 Nov 03 07:25:10 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:10 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Volume volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7 (cc7b8946-8c70-4534-b9ff-786c2a1dcfb7): created successfully Nov 03 07:25:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f87cd0-0967-4e29-9754-44edcddb0e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Flow 'volume_create_manager' (63ea1391-2348-429d-9162-df8c7353dc6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:25:10 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-0374e0b8-5c5f-4d59-b777-1a44cede5768 tempest-VolumesDeleteCascade-1387157953 None] Created volume successfully. Nov 03 07:25:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d3167e75-fe05-4d40-8b3f-7f36e66b30ce tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:25:11 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50e4614a-c975-470f-981f-5a77366b495b 1073741824" returned: 0 in 1.260s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50e4614a-c975-470f-981f-5a77366b495b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:11 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50e4614a-c975-470f-981f-5a77366b495b Nov 03 07:25:11 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:12 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50e4614a-c975-470f-981f-5a77366b495b" returned: 0 in 0.395s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:25:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:25:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d3167e75-fe05-4d40-8b3f-7f36e66b30ce tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.591s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:25:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b21f353-553a-4546-b55a-36965d400a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50e4614a-c975-470f-981f-5a77366b495b', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d548d35-08c2-4abe-8ae4-bb475a8dd1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-d3167e75-fe05-4d40-8b3f-7f36e66b30ce tempest-VolumesDeleteCascade-1387157953 None] Creating offline snapshot e4a5eb1b-52e0-4996-845e-3914e8646698 of volume cc7b8946-8c70-4534-b9ff-786c2a1dcfb7 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:25:12 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Volume volume-50e4614a-c975-470f-981f-5a77366b495b (50e4614a-c975-470f-981f-5a77366b495b): created successfully Nov 03 07:25:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d548d35-08c2-4abe-8ae4-bb475a8dd1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Flow 'volume_create_manager' (b7c439b0-02ab-403b-8979-fcfb3951e63f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:25:12 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe85d3c7-276b-42cb-aa7e-d987efd68834]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:25:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d3167e75-fe05-4d40-8b3f-7f36e66b30ce tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:12 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-6188b283-c613-45d4-a40d-3688459c4db2 tempest-VolumesAdminNegativeTest-1097046853 None] Created volume successfully. Nov 03 07:25:12 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7 Nov 03 07:25:12 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:12 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d3167e75-fe05-4d40-8b3f-7f36e66b30ce tempest-VolumesDeleteCascade-1387157953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7" returned: 0 in 0.578s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d3167e75-fe05-4d40-8b3f-7f36e66b30ce tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:12 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698 1G Nov 03 07:25:12 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:13 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d3167e75-fe05-4d40-8b3f-7f36e66b30ce tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698 1G" returned: 0 in 0.642s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d3167e75-fe05-4d40-8b3f-7f36e66b30ce tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:13 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698 Nov 03 07:25:13 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-97ce01d0-cbf4-4d50-a7b2-7dba7b5e49f9 tempest-VolumesAdminNegativeTest-1097046853 None] Acquiring lock "cinder-50e4614a-c975-470f-981f-5a77366b495b-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:25:13 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d3167e75-fe05-4d40-8b3f-7f36e66b30ce tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698" returned: 0 in 0.455s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:13 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-d3167e75-fe05-4d40-8b3f-7f36e66b30ce tempest-VolumesDeleteCascade-1387157953 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698 is being set with open permissions: ugo+rw Nov 03 07:25:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d3167e75-fe05-4d40-8b3f-7f36e66b30ce tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-97ce01d0-cbf4-4d50-a7b2-7dba7b5e49f9 tempest-VolumesAdminNegativeTest-1097046853 None] Lock "cinder-50e4614a-c975-470f-981f-5a77366b495b-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:25:13 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698 Nov 03 07:25:13 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-97ce01d0-cbf4-4d50-a7b2-7dba7b5e49f9 tempest-VolumesAdminNegativeTest-1097046853 None] Acquiring lock "cinder-quobyte-50e4614a-c975-470f-981f-5a77366b495b" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:25:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-97ce01d0-cbf4-4d50-a7b2-7dba7b5e49f9 tempest-VolumesAdminNegativeTest-1097046853 None] Lock "cinder-quobyte-50e4614a-c975-470f-981f-5a77366b495b" acquired by "delete_volume" :: waited 0.039s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:25:14 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cbc259-7cb7-4f55-99d5-b8a05074ef28]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:25:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-97ce01d0-cbf4-4d50-a7b2-7dba7b5e49f9 tempest-VolumesAdminNegativeTest-1097046853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50e4614a-c975-470f-981f-5a77366b495b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:14 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d3167e75-fe05-4d40-8b3f-7f36e66b30ce tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698" returned: 0 in 0.351s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:14 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50e4614a-c975-470f-981f-5a77366b495b Nov 03 07:25:14 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d3167e75-fe05-4d40-8b3f-7f36e66b30ce tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:14 devstack sudo[90594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.info Nov 03 07:25:14 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:14 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-97ce01d0-cbf4-4d50-a7b2-7dba7b5e49f9 tempest-VolumesAdminNegativeTest-1097046853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50e4614a-c975-470f-981f-5a77366b495b" returned: 0 in 0.567s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-97ce01d0-cbf4-4d50-a7b2-7dba7b5e49f9 tempest-VolumesAdminNegativeTest-1097046853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50e4614a-c975-470f-981f-5a77366b495b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:14 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d3167e75-fe05-4d40-8b3f-7f36e66b30ce tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.info" returned: 0 in 0.369s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:14 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-d3167e75-fe05-4d40-8b3f-7f36e66b30ce tempest-VolumesDeleteCascade-1387157953 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.info is being set with open permissions: ugo+rw Nov 03 07:25:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d3167e75-fe05-4d40-8b3f-7f36e66b30ce tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:14 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50e4614a-c975-470f-981f-5a77366b495b Nov 03 07:25:14 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:14 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.info Nov 03 07:25:14 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:15 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d3167e75-fe05-4d40-8b3f-7f36e66b30ce tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.info" returned: 0 in 0.328s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d3167e75-fe05-4d40-8b3f-7f36e66b30ce tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.939s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:25:15 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-97ce01d0-cbf4-4d50-a7b2-7dba7b5e49f9 tempest-VolumesAdminNegativeTest-1097046853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50e4614a-c975-470f-981f-5a77366b495b" returned: 0 in 0.401s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-97ce01d0-cbf4-4d50-a7b2-7dba7b5e49f9 tempest-VolumesAdminNegativeTest-1097046853 None] Lock "cinder-quobyte-50e4614a-c975-470f-981f-5a77366b495b" released by "delete_volume" :: held 1.054s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:25:15 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-d3167e75-fe05-4d40-8b3f-7f36e66b30ce tempest-VolumesDeleteCascade-1387157953 None] Create snapshot completed successfully Nov 03 07:25:15 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-97ce01d0-cbf4-4d50-a7b2-7dba7b5e49f9 tempest-VolumesAdminNegativeTest-1097046853 None] Created reservations ['6ac6554a-6542-49d7-b3a6-9b34a6e262e3', '75f4e92a-c6de-428a-9801-c539b54d92cc', 'ffd33185-0b59-47a0-bb44-00edc7879f7a', '76ad941b-0c4b-48e9-8b32-e45e26fee280'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:25:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-97ce01d0-cbf4-4d50-a7b2-7dba7b5e49f9 tempest-VolumesAdminNegativeTest-1097046853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:25:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-97ce01d0-cbf4-4d50-a7b2-7dba7b5e49f9 tempest-VolumesAdminNegativeTest-1097046853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:25:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-97ce01d0-cbf4-4d50-a7b2-7dba7b5e49f9 tempest-VolumesAdminNegativeTest-1097046853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:25:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-97ce01d0-cbf4-4d50-a7b2-7dba7b5e49f9 tempest-VolumesAdminNegativeTest-1097046853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:25:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-97ce01d0-cbf4-4d50-a7b2-7dba7b5e49f9 tempest-VolumesAdminNegativeTest-1097046853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:25:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-97ce01d0-cbf4-4d50-a7b2-7dba7b5e49f9 tempest-VolumesAdminNegativeTest-1097046853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:15 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:25:15 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:15 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-97ce01d0-cbf4-4d50-a7b2-7dba7b5e49f9 tempest-VolumesAdminNegativeTest-1097046853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.284s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:15 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-97ce01d0-cbf4-4d50-a7b2-7dba7b5e49f9 tempest-VolumesAdminNegativeTest-1097046853 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:25:15 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-97ce01d0-cbf4-4d50-a7b2-7dba7b5e49f9 tempest-VolumesAdminNegativeTest-1097046853 None] Deleted volume successfully. Nov 03 07:25:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-97ce01d0-cbf4-4d50-a7b2-7dba7b5e49f9 tempest-VolumesAdminNegativeTest-1097046853 None] Lock "cinder-50e4614a-c975-470f-981f-5a77366b495b-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:25:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-600154fb-5442-4ca6-a852-a611e74a4ed5 tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:25:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-600154fb-5442-4ca6-a852-a611e74a4ed5 tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:25:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-600154fb-5442-4ca6-a852-a611e74a4ed5 tempest-VolumesDeleteCascade-1387157953 None] Creating offline snapshot 397ff5f0-5689-4e54-8f23-a2d71f7e1cd5 of volume cc7b8946-8c70-4534-b9ff-786c2a1dcfb7 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:25:16 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce769437-4f32-4941-b0e0-d9414640b9f4]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:25:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-600154fb-5442-4ca6-a852-a611e74a4ed5 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:16 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698 Nov 03 07:25:16 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:16 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-600154fb-5442-4ca6-a852-a611e74a4ed5 tempest-VolumesDeleteCascade-1387157953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698" returned: 0 in 0.680s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-600154fb-5442-4ca6-a852-a611e74a4ed5 tempest-VolumesDeleteCascade-1387157953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:25:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-600154fb-5442-4ca6-a852-a611e74a4ed5 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.397ff5f0-5689-4e54-8f23-a2d71f7e1cd5 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:16 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.397ff5f0-5689-4e54-8f23-a2d71f7e1cd5 1G Nov 03 07:25:16 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:17 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-600154fb-5442-4ca6-a852-a611e74a4ed5 tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.397ff5f0-5689-4e54-8f23-a2d71f7e1cd5 1G" returned: 0 in 0.961s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-600154fb-5442-4ca6-a852-a611e74a4ed5 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.397ff5f0-5689-4e54-8f23-a2d71f7e1cd5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:17 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.397ff5f0-5689-4e54-8f23-a2d71f7e1cd5 Nov 03 07:25:17 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:18 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-600154fb-5442-4ca6-a852-a611e74a4ed5 tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.397ff5f0-5689-4e54-8f23-a2d71f7e1cd5" returned: 0 in 0.688s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:18 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-600154fb-5442-4ca6-a852-a611e74a4ed5 tempest-VolumesDeleteCascade-1387157953 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.397ff5f0-5689-4e54-8f23-a2d71f7e1cd5 is being set with open permissions: ugo+rw Nov 03 07:25:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-600154fb-5442-4ca6-a852-a611e74a4ed5 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.397ff5f0-5689-4e54-8f23-a2d71f7e1cd5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:18 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.397ff5f0-5689-4e54-8f23-a2d71f7e1cd5 Nov 03 07:25:18 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:18 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-5965c1ca-e654-4c59-b72a-acf8cffc8c35 req-25b39ef9-3548-4571-b7c9-6d4fac149e9d tempest-ServerActionsTestOtherA-1421339689 None] Terminate volume connection completed successfully. Nov 03 07:25:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-5965c1ca-e654-4c59-b72a-acf8cffc8c35 req-25b39ef9-3548-4571-b7c9-6d4fac149e9d tempest-ServerActionsTestOtherA-1421339689 None] Deleting attachment 19dda318-0195-4293-91ab-bb482df6851b. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:25:19 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-600154fb-5442-4ca6-a852-a611e74a4ed5 tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.397ff5f0-5689-4e54-8f23-a2d71f7e1cd5" returned: 0 in 0.513s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-600154fb-5442-4ca6-a852-a611e74a4ed5 tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.046s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:25:19 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-600154fb-5442-4ca6-a852-a611e74a4ed5 tempest-VolumesDeleteCascade-1387157953 None] Create snapshot completed successfully Nov 03 07:25:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "cinder-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:25:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:25:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Performing cascade delete. {{(pid=87016) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 07:25:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "cinder-397ff5f0-5689-4e54-8f23-a2d71f7e1cd5-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:25:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-397ff5f0-5689-4e54-8f23-a2d71f7e1cd5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:25:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "cinder-quobyte-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:25:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-quobyte-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:25:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "cinder-quobyte-397ff5f0-5689-4e54-8f23-a2d71f7e1cd5" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:25:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-quobyte-397ff5f0-5689-4e54-8f23-a2d71f7e1cd5" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:25:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Deleting offline snapshot 397ff5f0-5689-4e54-8f23-a2d71f7e1cd5 of volume cc7b8946-8c70-4534-b9ff-786c2a1dcfb7 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:25:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] snapshot_file for this snap is: volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.397ff5f0-5689-4e54-8f23-a2d71f7e1cd5 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:25:19 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fb6cfb-5e88-4e40-b6c5-5d041ff5cab2]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:25:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.397ff5f0-5689-4e54-8f23-a2d71f7e1cd5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:19 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.397ff5f0-5689-4e54-8f23-a2d71f7e1cd5 Nov 03 07:25:19 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:20 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.397ff5f0-5689-4e54-8f23-a2d71f7e1cd5" returned: 0 in 0.655s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:20 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:25:20 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b2a8dc-d1e6-41ca-818a-676ab0577b46]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:25:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:20 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698 Nov 03 07:25:20 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:20 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698" returned: 0 in 0.543s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:20 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:25:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.397ff5f0-5689-4e54-8f23-a2d71f7e1cd5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:20 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.397ff5f0-5689-4e54-8f23-a2d71f7e1cd5 Nov 03 07:25:20 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:21 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.397ff5f0-5689-4e54-8f23-a2d71f7e1cd5" returned: 0 in 0.564s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.397ff5f0-5689-4e54-8f23-a2d71f7e1cd5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:21 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.397ff5f0-5689-4e54-8f23-a2d71f7e1cd5 Nov 03 07:25:21 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:21 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.397ff5f0-5689-4e54-8f23-a2d71f7e1cd5" returned: 0 in 0.425s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:21 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-quobyte-397ff5f0-5689-4e54-8f23-a2d71f7e1cd5" released by "_delete_snapshot" :: held 2.350s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:25:21 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-quobyte-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7" released by "delete_snapshot" :: held 2.390s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:25:22 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Created reservations ['a5152b37-e329-412b-a576-fe4723735518', '9e58f70f-4625-455a-a07d-bf9c1a6d7ba7', 'e9f81b4c-80b5-49d2-8a0b-0431dee35d0f', '5282d613-d193-46ca-8811-d899e60835fa'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:25:22 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Delete snapshot completed successfully. Nov 03 07:25:22 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-397ff5f0-5689-4e54-8f23-a2d71f7e1cd5-delete_snapshot" released by "delete_snapshot" :: held 2.621s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:25:22 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "cinder-e4a5eb1b-52e0-4996-845e-3914e8646698-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:25:22 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-e4a5eb1b-52e0-4996-845e-3914e8646698-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:25:22 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "cinder-quobyte-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:25:22 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-quobyte-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:25:22 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "cinder-quobyte-e4a5eb1b-52e0-4996-845e-3914e8646698" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:25:22 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-quobyte-e4a5eb1b-52e0-4996-845e-3914e8646698" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:25:22 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Deleting offline snapshot e4a5eb1b-52e0-4996-845e-3914e8646698 of volume cc7b8946-8c70-4534-b9ff-786c2a1dcfb7 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:25:22 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] snapshot_file for this snap is: volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:25:22 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f39e174-26ac-4063-a5ce-d756d9f04aff]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:25:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:22 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698 Nov 03 07:25:22 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:22 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698" returned: 0 in 0.413s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:22 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:25:22 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf785d9-f4f3-4075-adac-0966dee48455]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:25:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:22 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7 Nov 03 07:25:22 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:23 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7" returned: 0 in 0.475s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:23 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698 Nov 03 07:25:23 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:23 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698" returned: 0 in 0.458s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:23 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698 Nov 03 07:25:23 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:23 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7.e4a5eb1b-52e0-4996-845e-3914e8646698" returned: 0 in 0.272s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:23 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-quobyte-e4a5eb1b-52e0-4996-845e-3914e8646698" released by "_delete_snapshot" :: held 1.766s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:25:23 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-quobyte-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7" released by "delete_snapshot" :: held 1.794s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:25:24 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Created reservations ['d55b65f7-4e07-4817-9090-ecdab71e1706', '01e5e967-7a32-4126-8fc5-e2cebec7c552', 'dc492d5c-6d81-4f9a-ad28-d385f2dd2c6c', '33ac3bb5-f18d-40b4-ae3d-a16b3491c3b3'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:25:24 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Delete snapshot completed successfully. Nov 03 07:25:24 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-e4a5eb1b-52e0-4996-845e-3914e8646698-delete_snapshot" released by "delete_snapshot" :: held 1.986s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:25:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Snapshots deleted, issuing volume delete {{(pid=87016) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 07:25:24 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "cinder-quobyte-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:25:24 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-quobyte-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7" acquired by "delete_volume" :: waited 0.020s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:25:24 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda4aa36-9e5e-4c35-9cc1-a3d3ce3875ae]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:25:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:24 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7 Nov 03 07:25:24 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:24 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7" returned: 0 in 0.509s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:24 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7 Nov 03 07:25:24 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:25 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7" returned: 0 in 0.379s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:25 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-quobyte-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7" released by "delete_volume" :: held 1.013s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:25:25 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Created reservations ['fc269ef0-5bab-4137-b1b0-21652c5468e0', 'a5c6179a-1354-43cf-b5a2-76d51cfddf9a', '2bea9580-45e0-43c7-b02b-80fcae738be1', '5d7c6ec8-4314-42be-b11f-96bc0b937b50'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:25:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:25:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:25:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:25:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:25:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:25:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:25 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:25:25 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:25 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.285s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:25 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:25:25 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Deleted volume successfully. Nov 03 07:25:25 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e3fc5db5-5388-44ee-a762-358e45fd215d tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-cc7b8946-8c70-4534-b9ff-786c2a1dcfb7-delete_volume" released by "delete_volume" :: held 6.227s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:25:27 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:25:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Flow 'volume_create_manager' (af3be19d-d889-4a08-839e-2f50123415e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:25:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c78e78-0ea0-4f93-8530-561cd5fefb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c78e78-0ea0-4f93-8530-561cd5fefb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-975149496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79bd2701-d08e-4c0b-9df5-e4747761f768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad30beebe96d488aaf22e85bc1fa2fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:25:27Z,use_quota=True,user_id='e2e4fa56f1744d7abaa1cd38eb8b7e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02507a6-f4ff-4dd9-b559-63a0aaf7fd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02507a6-f4ff-4dd9-b559-63a0aaf7fd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d8b62b-52eb-4eaf-a398-9074a4b9bc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d8b62b-52eb-4eaf-a398-9074a4b9bc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79bd2701-d08e-4c0b-9df5-e4747761f768', 'volume_name': 'volume-79bd2701-d08e-4c0b-9df5-e4747761f768', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23d05f4-6604-49ca-add8-eb10e4968c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23d05f4-6604-49ca-add8-eb10e4968c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ece694-24bc-40a5-b102-caafa544bf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:27 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Volume 79bd2701-d08e-4c0b-9df5-e4747761f768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79bd2701-d08e-4c0b-9df5-e4747761f768', 'volume_size': 1} Nov 03 07:25:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:25:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:25:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-975149496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79bd2701-d08e-4c0b-9df5-e4747761f768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad30beebe96d488aaf22e85bc1fa2fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:25:27Z,use_quota=True,user_id='e2e4fa56f1744d7abaa1cd38eb8b7e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:25:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Creating volume 79bd2701-d08e-4c0b-9df5-e4747761f768 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:25:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:25:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:25:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:25:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:25:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:25:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:25:27 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:25:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:27 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768 1073741824 Nov 03 07:25:27 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:28 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768 1073741824" returned: 0 in 0.717s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:28 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768 Nov 03 07:25:28 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:28 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768" returned: 0 in 0.392s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:25:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:25:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ece694-24bc-40a5-b102-caafa544bf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79bd2701-d08e-4c0b-9df5-e4747761f768', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2613950-306b-464a-8cbf-b4d22c16ba7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:28 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Volume volume-79bd2701-d08e-4c0b-9df5-e4747761f768 (79bd2701-d08e-4c0b-9df5-e4747761f768): created successfully Nov 03 07:25:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2613950-306b-464a-8cbf-b4d22c16ba7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Flow 'volume_create_manager' (af3be19d-d889-4a08-839e-2f50123415e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:25:28 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-776ba1a8-43b2-4e01-8b79-9c0b45c83d37 tempest-VolumesDeleteCascade-1387157953 None] Created volume successfully. Nov 03 07:25:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b78ff1e2-c271-474e-9890-1085cf118a11 tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:25:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b78ff1e2-c271-474e-9890-1085cf118a11 tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:25:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-b78ff1e2-c271-474e-9890-1085cf118a11 tempest-VolumesDeleteCascade-1387157953 None] Creating offline snapshot 68677531-7015-4854-a847-9b13e7914c34 of volume 79bd2701-d08e-4c0b-9df5-e4747761f768 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:25:29 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0d3e17-da95-44cd-a305-796aa30565d1]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:25:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b78ff1e2-c271-474e-9890-1085cf118a11 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:29 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768 Nov 03 07:25:29 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:30 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b78ff1e2-c271-474e-9890-1085cf118a11 tempest-VolumesDeleteCascade-1387157953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768" returned: 0 in 0.405s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b78ff1e2-c271-474e-9890-1085cf118a11 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.68677531-7015-4854-a847-9b13e7914c34 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:30 devstack sudo[90770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.68677531-7015-4854-a847-9b13e7914c34 1G Nov 03 07:25:30 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:30 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b78ff1e2-c271-474e-9890-1085cf118a11 tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.68677531-7015-4854-a847-9b13e7914c34 1G" returned: 0 in 0.587s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b78ff1e2-c271-474e-9890-1085cf118a11 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79bd2701-d08e-4c0b-9df5-e4747761f768 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.68677531-7015-4854-a847-9b13e7914c34 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:30 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79bd2701-d08e-4c0b-9df5-e4747761f768 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.68677531-7015-4854-a847-9b13e7914c34 Nov 03 07:25:30 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:31 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b78ff1e2-c271-474e-9890-1085cf118a11 tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79bd2701-d08e-4c0b-9df5-e4747761f768 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.68677531-7015-4854-a847-9b13e7914c34" returned: 0 in 0.326s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:31 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-b78ff1e2-c271-474e-9890-1085cf118a11 tempest-VolumesDeleteCascade-1387157953 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.68677531-7015-4854-a847-9b13e7914c34 is being set with open permissions: ugo+rw Nov 03 07:25:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b78ff1e2-c271-474e-9890-1085cf118a11 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.68677531-7015-4854-a847-9b13e7914c34 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:31 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.68677531-7015-4854-a847-9b13e7914c34 Nov 03 07:25:31 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:31 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b78ff1e2-c271-474e-9890-1085cf118a11 tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.68677531-7015-4854-a847-9b13e7914c34" returned: 0 in 0.271s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b78ff1e2-c271-474e-9890-1085cf118a11 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:31 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.info Nov 03 07:25:31 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:31 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b78ff1e2-c271-474e-9890-1085cf118a11 tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.info" returned: 0 in 0.386s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:31 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-b78ff1e2-c271-474e-9890-1085cf118a11 tempest-VolumesDeleteCascade-1387157953 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.info is being set with open permissions: ugo+rw Nov 03 07:25:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b78ff1e2-c271-474e-9890-1085cf118a11 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:31 devstack sudo[90790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.info Nov 03 07:25:31 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:32 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b78ff1e2-c271-474e-9890-1085cf118a11 tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.info" returned: 0 in 0.264s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b78ff1e2-c271-474e-9890-1085cf118a11 tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.381s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:25:32 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b78ff1e2-c271-474e-9890-1085cf118a11 tempest-VolumesDeleteCascade-1387157953 None] Create snapshot completed successfully Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Flow 'volume_create_manager' (e917bea1-7b59-453a-a787-b6441f76c03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868d63be-005c-4055-abbc-1026f491bc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868d63be-005c-4055-abbc-1026f491bc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1426822047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa00aba-6f31-4b83-9605-5449fe27fe67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fda04c13e28c4d42be2069e1025f2e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:25:33Z,use_quota=True,user_id='d3d9db9cd307427fb8b472a1c627b54c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82722540-36d7-4e37-b5e2-52ee618bc3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82722540-36d7-4e37-b5e2-52ee618bc3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31940150-7e1c-4e56-9a2a-28837e9b926a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.image.glance [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Creating Keystone auth plugin from conf {{(pid=87016) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Flow 'volume_create_manager' (60b207f6-1d24-465a-941a-b6b43f032378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f947b6c8-c722-43d4-981b-592472b8fb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f947b6c8-c722-43d4-981b-592472b8fb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1217334139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2de4d55-138a-4e4f-9433-f21ec0522d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad30beebe96d488aaf22e85bc1fa2fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=68677531-7015-4854-a847-9b13e7914c34,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:25:34Z,use_quota=True,user_id='e2e4fa56f1744d7abaa1cd38eb8b7e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2992b255-a811-435b-b1c5-bdcf045487d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2992b255-a811-435b-b1c5-bdcf045487d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16b5a0d-2cc1-431f-8178-93ed4f38a5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16b5a0d-2cc1-431f-8178-93ed4f38a5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a2de4d55-138a-4e4f-9433-f21ec0522d5a', 'volume_name': 'volume-a2de4d55-138a-4e4f-9433-f21ec0522d5a', 'volume_size': 1, 'snapshot_id': '68677531-7015-4854-a847-9b13e7914c34'}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850a341b-d533-4b1f-ad64-b85410fcb4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850a341b-d533-4b1f-ad64-b85410fcb4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc869b98-1e75-4f47-a21a-5a97c5c9b03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:33 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Volume a2de4d55-138a-4e4f-9433-f21ec0522d5a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a2de4d55-138a-4e4f-9433-f21ec0522d5a', 'volume_size': 1, 'snapshot_id': '68677531-7015-4854-a847-9b13e7914c34'} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "cinder-quobyte-68677531-7015-4854-a847-9b13e7914c34-a2de4d55-138a-4e4f-9433-f21ec0522d5a" by "_create_volume_from_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-quobyte-68677531-7015-4854-a847-9b13e7914c34-a2de4d55-138a-4e4f-9433-f21ec0522d5a" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Creating volume a2de4d55-138a-4e4f-9433-f21ec0522d5a from snapshot 68677531-7015-4854-a847-9b13e7914c34 {{(pid=87016) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "cinder-quobyte-a2de4d55-138a-4e4f-9433-f21ec0522d5a" by "_copy_volume_from_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-quobyte-a2de4d55-138a-4e4f-9433-f21ec0522d5a" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] snapshot: 68677531-7015-4854-a847-9b13e7914c34, volume: a2de4d55-138a-4e4f-9433-f21ec0522d5a, {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:25:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:25:34 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd168aac-9809-4a9f-8003-1a11f74024ba]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:25:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.68677531-7015-4854-a847-9b13e7914c34 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31940150-7e1c-4e56-9a2a-28837e9b926a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2aa00aba-6f31-4b83-9605-5449fe27fe67', 'volume_name': 'volume-2aa00aba-6f31-4b83-9605-5449fe27fe67', 'volume_size': 1, 'image_id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bde64ec799a64fc39c0407ed31a11129', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'created_at': datetime.datetime(2026, 11, 3, 6, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51691990-b207-4b51-a481-1c1cb8355cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51691990-b207-4b51-a481-1c1cb8355cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9135f768-8b9b-48c9-acb4-ccf3e376aa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:34 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Volume 2aa00aba-6f31-4b83-9605-5449fe27fe67: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2aa00aba-6f31-4b83-9605-5449fe27fe67', 'volume_size': 1, 'image_id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bde64ec799a64fc39c0407ed31a11129', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'created_at': datetime.datetime(2026, 11, 3, 6, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 07:25:34 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Trying to clone 2aa00aba-6f31-4b83-9605-5449fe27fe67 from image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb at location (None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}]). {{(pid=87016) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:25:34 devstack sudo[90799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.68677531-7015-4854-a847-9b13e7914c34 Nov 03 07:25:34 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:34 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:34 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7pmmi7t_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:25:34 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Image download 20.69 MB at 20.69 MB/s Nov 03 07:25:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.68677531-7015-4854-a847-9b13e7914c34" returned: 0 in 0.828s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79bd2701-d08e-4c0b-9df5-e4747761f768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:25:34 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ab092f-b0f3-4830-acdd-313cb38ac239]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:25:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:34 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b55593-9a5c-4c18-9455-07076c7696e7]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:25:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7pmmi7t_devstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:35 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768 Nov 03 07:25:35 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:35 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7pmmi7t_devstack@QuobyteHD Nov 03 07:25:35 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:35 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7pmmi7t_devstack@QuobyteHD" returned: 0 in 0.486s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:35 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Temporary image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb is fetched for user d3d9db9cd307427fb8b472a1c627b54c. {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:25:35 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768" returned: 0 in 0.584s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768 {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:25:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Creating direct copy from snapshot {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:25:35 devstack cinder-volume[87016]: DEBUG cinder.utils [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Path /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a2de4d55-138a-4e4f-9433-f21ec0522d5a not found in is_blk_device check {{(pid=87016) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 07:25:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a2de4d55-138a-4e4f-9433-f21ec0522d5a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:35 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a2de4d55-138a-4e4f-9433-f21ec0522d5a Nov 03 07:25:35 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:35 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ff77c7-33e1-40f5-9ff9-c23f05dbde04]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:25:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7pmmi7t_devstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:35 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7pmmi7t_devstack@QuobyteHD Nov 03 07:25:35 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:36 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7pmmi7t_devstack@QuobyteHD" returned: 0 in 0.506s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:25:45 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:UPDATE=40,cinder:SELECT=38,cinder:INSERT=15,cinder:DELETE=6 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:25:45 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=44,cinder:UPDATE=42,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:25:46 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a2de4d55-138a-4e4f-9433-f21ec0522d5a" returned: 0 in 10.715s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:46 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Image conversion details: src /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768, size 1024.00 MB, duration 10.72 sec, destination /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a2de4d55-138a-4e4f-9433-f21ec0522d5a {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:25:46 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Converted 1024.00 MB image at 95.56 MB/s Nov 03 07:25:46 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a2de4d55-138a-4e4f-9433-f21ec0522d5a is being set with open permissions: ugo+rw Nov 03 07:25:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a2de4d55-138a-4e4f-9433-f21ec0522d5a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:46 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a2de4d55-138a-4e4f-9433-f21ec0522d5a Nov 03 07:25:46 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:46 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a2de4d55-138a-4e4f-9433-f21ec0522d5a" returned: 0 in 0.454s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-quobyte-a2de4d55-138a-4e4f-9433-f21ec0522d5a" released by "_copy_volume_from_snapshot" :: held 12.714s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:25:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-quobyte-68677531-7015-4854-a847-9b13e7914c34-a2de4d55-138a-4e4f-9433-f21ec0522d5a" released by "_create_volume_from_snapshot" :: held 12.798s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:25:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.815s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:25:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.612s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:25:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1426822047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa00aba-6f31-4b83-9605-5449fe27fe67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fda04c13e28c4d42be2069e1025f2e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:25:33Z,use_quota=True,user_id='d3d9db9cd307427fb8b472a1c627b54c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:25:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Creating volume 2aa00aba-6f31-4b83-9605-5449fe27fe67 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:25:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:25:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:25:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:25:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:25:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:25:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:25:46 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:25:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2aa00aba-6f31-4b83-9605-5449fe27fe67 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc869b98-1e75-4f47-a21a-5a97c5c9b03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2de4d55-138a-4e4f-9433-f21ec0522d5a', 'volume_size': 1, 'snapshot_id': '68677531-7015-4854-a847-9b13e7914c34'}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435e3541-e283-4ab9-a8c6-effee3af82aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:46 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2aa00aba-6f31-4b83-9605-5449fe27fe67 1073741824 Nov 03 07:25:46 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:46 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Volume volume-a2de4d55-138a-4e4f-9433-f21ec0522d5a (a2de4d55-138a-4e4f-9433-f21ec0522d5a): created successfully Nov 03 07:25:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435e3541-e283-4ab9-a8c6-effee3af82aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Flow 'volume_create_manager' (60b207f6-1d24-465a-941a-b6b43f032378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:25:46 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-18dd5683-484b-42ed-a43c-48a33b4fd245 tempest-VolumesDeleteCascade-1387157953 None] Created volume successfully. Nov 03 07:25:47 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2aa00aba-6f31-4b83-9605-5449fe27fe67 1073741824" returned: 0 in 0.691s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2aa00aba-6f31-4b83-9605-5449fe27fe67 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:47 devstack sudo[90975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2aa00aba-6f31-4b83-9605-5449fe27fe67 Nov 03 07:25:47 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:47 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "cinder-79bd2701-d08e-4c0b-9df5-e4747761f768-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:25:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-79bd2701-d08e-4c0b-9df5-e4747761f768-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:25:48 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2aa00aba-6f31-4b83-9605-5449fe27fe67" returned: 0 in 0.584s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:25:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:25:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Performing cascade delete. {{(pid=87016) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 07:25:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "cinder-68677531-7015-4854-a847-9b13e7914c34-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:25:48 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Attempting download of 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb ((None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}])) to volume 2aa00aba-6f31-4b83-9605-5449fe27fe67. {{(pid=87016) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 03 07:25:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-68677531-7015-4854-a847-9b13e7914c34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:25:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "cinder-quobyte-79bd2701-d08e-4c0b-9df5-e4747761f768" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:25:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-quobyte-79bd2701-d08e-4c0b-9df5-e4747761f768" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:25:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "cinder-quobyte-68677531-7015-4854-a847-9b13e7914c34" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:25:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-quobyte-68677531-7015-4854-a847-9b13e7914c34" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:25:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Deleting offline snapshot 68677531-7015-4854-a847-9b13e7914c34 of volume 79bd2701-d08e-4c0b-9df5-e4747761f768 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:25:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] snapshot_file for this snap is: volume-79bd2701-d08e-4c0b-9df5-e4747761f768.68677531-7015-4854-a847-9b13e7914c34 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:25:48 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabf1c96-1fe7-468a-b767-d23b4d3b5097]: (4, 'raw') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:25:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_ktqwhxyp {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:48 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec7ff3e-986e-4777-ab32-d5166feda908]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:25:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.68677531-7015-4854-a847-9b13e7914c34 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:48 devstack sudo[90980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_ktqwhxyp Nov 03 07:25:48 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:48 devstack sudo[90982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.68677531-7015-4854-a847-9b13e7914c34 Nov 03 07:25:48 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:48 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_ktqwhxyp" returned: 0 in 0.596s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_ktqwhxyp {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:49 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.68677531-7015-4854-a847-9b13e7914c34" returned: 0 in 0.761s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79bd2701-d08e-4c0b-9df5-e4747761f768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:25:49 devstack sudo[90990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_ktqwhxyp Nov 03 07:25:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:25:49 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:25:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:25:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:25:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:25:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:25:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:49 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efd109a-06ee-4129-9bc0-c74d30833a89]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:25:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:49 devstack sudo[90993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:25:49 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:49 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768 Nov 03 07:25:49 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:49 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.457s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:25:49 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_ktqwhxyp" returned: 1 in 0.777s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_ktqwhxyp' failed. Not Retrying. {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:25:49 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d3dabe-4593-4a0c-b0f7-e6cdb991324a]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:25:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7pmmi7t_devstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:49 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7pmmi7t_devstack@QuobyteHD Nov 03 07:25:49 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:49 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768" returned: 0 in 0.859s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.68677531-7015-4854-a847-9b13e7914c34 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:50 devstack sudo[91005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.68677531-7015-4854-a847-9b13e7914c34 Nov 03 07:25:50 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:50 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7pmmi7t_devstack@QuobyteHD" returned: 0 in 0.467s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:50 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb was qcow2, converting to qcow2 {{(pid=87016) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:25:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7pmmi7t_devstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2aa00aba-6f31-4b83-9605-5449fe27fe67 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:50 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7pmmi7t_devstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2aa00aba-6f31-4b83-9605-5449fe27fe67 Nov 03 07:25:50 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:50 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.68677531-7015-4854-a847-9b13e7914c34" returned: 0 in 0.553s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.68677531-7015-4854-a847-9b13e7914c34 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:50 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.68677531-7015-4854-a847-9b13e7914c34 Nov 03 07:25:50 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:50 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768.68677531-7015-4854-a847-9b13e7914c34" returned: 0 in 0.436s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-quobyte-68677531-7015-4854-a847-9b13e7914c34" released by "_delete_snapshot" :: held 2.813s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:25:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-quobyte-79bd2701-d08e-4c0b-9df5-e4747761f768" released by "delete_snapshot" :: held 2.864s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:25:51 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Created reservations ['dfff7dfc-6177-4051-8415-8b9a022cfd13', '0bfa1b5f-5de9-40b7-b3ab-2390ffd33ccf', 'fac4b6c1-8fbe-40f6-be1a-1507c482b48c', 'd6c8e4bb-6ffe-4bb9-bc96-c078d6913d65'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:25:51 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Delete snapshot completed successfully. Nov 03 07:25:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-68677531-7015-4854-a847-9b13e7914c34-delete_snapshot" released by "delete_snapshot" :: held 3.139s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:25:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Snapshots deleted, issuing volume delete {{(pid=87016) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 07:25:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "cinder-quobyte-79bd2701-d08e-4c0b-9df5-e4747761f768" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:25:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-quobyte-79bd2701-d08e-4c0b-9df5-e4747761f768" acquired by "delete_volume" :: waited 0.046s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:25:51 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aabb40e-a657-4e66-8fbd-2949bd80754d]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:25:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:51 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768 Nov 03 07:25:51 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:52 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768" returned: 0 in 0.642s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:52 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768 Nov 03 07:25:52 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:52 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79bd2701-d08e-4c0b-9df5-e4747761f768" returned: 0 in 0.369s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-quobyte-79bd2701-d08e-4c0b-9df5-e4747761f768" released by "delete_volume" :: held 1.201s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:25:52 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Created reservations ['4694b0d6-d513-406c-a3a0-8fb078652072', 'f14824c0-ba6c-4cf3-84f6-d6f7ca24c73f', '522a4490-7488-4b2f-be9d-ac2052759bf9', 'ab6f1fa9-0da4-4594-b8c3-32d1fba5c2aa'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:25:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:25:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:25:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:25:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:25:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:25:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:52 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:25:52 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:53 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7pmmi7t_devstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2aa00aba-6f31-4b83-9605-5449fe27fe67" returned: 0 in 2.890s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:53 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7pmmi7t_devstack@QuobyteHD, size 112.00 MB, duration 2.89 sec, destination /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2aa00aba-6f31-4b83-9605-5449fe27fe67 {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:25:53 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Converted 112.00 MB image at 38.73 MB/s Nov 03 07:25:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2aa00aba-6f31-4b83-9605-5449fe27fe67 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:53 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2aa00aba-6f31-4b83-9605-5449fe27fe67 1G Nov 03 07:25:53 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:53 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.515s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:53 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:25:53 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Deleted volume successfully. Nov 03 07:25:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-aa28e568-a9f6-4f37-ae8d-c410cdb0b649 tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-79bd2701-d08e-4c0b-9df5-e4747761f768-delete_volume" released by "delete_volume" :: held 5.514s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:25:53 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2aa00aba-6f31-4b83-9605-5449fe27fe67 1G" returned: 0 in 0.577s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:53 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Downloaded image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb ((None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}])) to volume 2aa00aba-6f31-4b83-9605-5449fe27fe67 successfully. {{(pid=87016) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 03 07:25:53 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Temporary image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb for user d3d9db9cd307427fb8b472a1c627b54c is deleted. {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:25:53 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Marking volume 2aa00aba-6f31-4b83-9605-5449fe27fe67 as bootable. {{(pid=87016) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 03 07:25:53 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Copying metadata from image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb to 2aa00aba-6f31-4b83-9605-5449fe27fe67. {{(pid=87016) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:25:53 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Creating volume glance metadata for volume 2aa00aba-6f31-4b83-9605-5449fe27fe67 backed by image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87016) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:25:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9135f768-8b9b-48c9-acb4-ccf3e376aa23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aa00aba-6f31-4b83-9605-5449fe27fe67', 'volume_size': 1, 'image_id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bde64ec799a64fc39c0407ed31a11129', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'created_at': datetime.datetime(2026, 11, 3, 6, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e1552e-5b53-4d64-a136-47ae66b39d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:25:53 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Volume volume-2aa00aba-6f31-4b83-9605-5449fe27fe67 (2aa00aba-6f31-4b83-9605-5449fe27fe67): created successfully Nov 03 07:25:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e1552e-5b53-4d64-a136-47ae66b39d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:25:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Flow 'volume_create_manager' (e917bea1-7b59-453a-a787-b6441f76c03b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:25:53 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-17145810-f6ad-49bf-82ef-f668cd099456 tempest-ServerActionsTestOtherA-1421339689 None] Created volume successfully. Nov 03 07:25:54 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b2b2911f-edc5-4035-bc91-f0c07a840207 tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "cinder-a2de4d55-138a-4e4f-9433-f21ec0522d5a-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:25:54 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b2b2911f-edc5-4035-bc91-f0c07a840207 tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-a2de4d55-138a-4e4f-9433-f21ec0522d5a-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:25:54 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b2b2911f-edc5-4035-bc91-f0c07a840207 tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "cinder-quobyte-a2de4d55-138a-4e4f-9433-f21ec0522d5a" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:25:54 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b2b2911f-edc5-4035-bc91-f0c07a840207 tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-quobyte-a2de4d55-138a-4e4f-9433-f21ec0522d5a" acquired by "delete_volume" :: waited 0.024s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:25:54 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[89238fe7-02a7-4635-82e2-7f0fc9f57bc4]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:25:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b2b2911f-edc5-4035-bc91-f0c07a840207 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a2de4d55-138a-4e4f-9433-f21ec0522d5a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:54 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a2de4d55-138a-4e4f-9433-f21ec0522d5a Nov 03 07:25:54 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:54 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b2b2911f-edc5-4035-bc91-f0c07a840207 tempest-VolumesDeleteCascade-1387157953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a2de4d55-138a-4e4f-9433-f21ec0522d5a" returned: 0 in 0.570s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b2b2911f-edc5-4035-bc91-f0c07a840207 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a2de4d55-138a-4e4f-9433-f21ec0522d5a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:54 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a2de4d55-138a-4e4f-9433-f21ec0522d5a Nov 03 07:25:54 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:55 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b2b2911f-edc5-4035-bc91-f0c07a840207 tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a2de4d55-138a-4e4f-9433-f21ec0522d5a" returned: 0 in 0.428s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b2b2911f-edc5-4035-bc91-f0c07a840207 tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-quobyte-a2de4d55-138a-4e4f-9433-f21ec0522d5a" released by "delete_volume" :: held 1.077s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:25:55 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-b2b2911f-edc5-4035-bc91-f0c07a840207 tempest-VolumesDeleteCascade-1387157953 None] Created reservations ['a8414b75-68ce-4f0f-a104-2e35021f462b', '020c08f4-1175-49b6-abf4-cbda4d78a25f', 'c59bea0f-a69b-4817-98cb-9ef92e107f5c', 'd665c2c9-9a08-4e96-b7a8-cc4d3c39c56f'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:25:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b2b2911f-edc5-4035-bc91-f0c07a840207 tempest-VolumesDeleteCascade-1387157953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:25:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b2b2911f-edc5-4035-bc91-f0c07a840207 tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:25:55 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b2b2911f-edc5-4035-bc91-f0c07a840207 tempest-VolumesDeleteCascade-1387157953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:25:55 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b2b2911f-edc5-4035-bc91-f0c07a840207 tempest-VolumesDeleteCascade-1387157953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:25:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b2b2911f-edc5-4035-bc91-f0c07a840207 tempest-VolumesDeleteCascade-1387157953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:25:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b2b2911f-edc5-4035-bc91-f0c07a840207 tempest-VolumesDeleteCascade-1387157953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:55 devstack sudo[91050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:25:55 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:55 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b2b2911f-edc5-4035-bc91-f0c07a840207 tempest-VolumesDeleteCascade-1387157953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.547s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:55 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-b2b2911f-edc5-4035-bc91-f0c07a840207 tempest-VolumesDeleteCascade-1387157953 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:25:55 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b2b2911f-edc5-4035-bc91-f0c07a840207 tempest-VolumesDeleteCascade-1387157953 None] Deleted volume successfully. Nov 03 07:25:56 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b2b2911f-edc5-4035-bc91-f0c07a840207 tempest-VolumesDeleteCascade-1387157953 None] Lock "cinder-a2de4d55-138a-4e4f-9433-f21ec0522d5a-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:25:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-529fa882-5f05-4b2e-86e0-85fd931122e8 req-a3206453-7f24-49fe-ae71-31d90c542e0e tempest-ServerActionsTestOtherA-1421339689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:25:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-529fa882-5f05-4b2e-86e0-85fd931122e8 req-a3206453-7f24-49fe-ae71-31d90c542e0e tempest-ServerActionsTestOtherA-1421339689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:25:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-529fa882-5f05-4b2e-86e0-85fd931122e8 req-a3206453-7f24-49fe-ae71-31d90c542e0e tempest-ServerActionsTestOtherA-1421339689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:25:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-529fa882-5f05-4b2e-86e0-85fd931122e8 req-a3206453-7f24-49fe-ae71-31d90c542e0e tempest-ServerActionsTestOtherA-1421339689 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14', 'name': 'volume-2aa00aba-6f31-4b83-9605-5449fe27fe67', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e2685d6-e5f6-45a9-af20-44b0f808d897', 'enforce_multipath': True} {{(pid=87016) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:25:58 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-529fa882-5f05-4b2e-86e0-85fd931122e8 req-a3206453-7f24-49fe-ae71-31d90c542e0e tempest-ServerActionsTestOtherA-1421339689 None] attachment_update completed successfully. Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=30,cinder:UPDATE=27,cinder:INSERT=12,cinder:DELETE=1 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:UPDATE=32,cinder:SELECT=32,cinder:INSERT=14,cinder:DELETE=3 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Flow 'volume_create_manager' (219287ad-03bf-47de-8b72-4ee8a7bc172b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ffcbb15-6fd4-4ffe-9d63-183b2f077c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ffcbb15-6fd4-4ffe-9d63-183b2f077c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1946910584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99163771-bc1a-425f-a111-9c7c71ccec49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485c1b2e7e034556a572fe1555b9437f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:26:09Z,use_quota=True,user_id='3915baa0841c4d00bbf3ac646ec2c32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1205fd-55dd-46a3-9ece-8c08c2cf4375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1205fd-55dd-46a3-9ece-8c08c2cf4375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b0d64c-94ff-4cb6-b067-fc6cb83375fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b0d64c-94ff-4cb6-b067-fc6cb83375fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99163771-bc1a-425f-a111-9c7c71ccec49', 'volume_name': 'volume-99163771-bc1a-425f-a111-9c7c71ccec49', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f5e28f-3a13-43de-9d5e-af50caae93d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f5e28f-3a13-43de-9d5e-af50caae93d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38cd58a8-ace9-4104-8c1b-f396c545dc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:26:08 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Volume 99163771-bc1a-425f-a111-9c7c71ccec49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99163771-bc1a-425f-a111-9c7c71ccec49', 'volume_size': 1} Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1946910584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99163771-bc1a-425f-a111-9c7c71ccec49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485c1b2e7e034556a572fe1555b9437f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:26:09Z,use_quota=True,user_id='3915baa0841c4d00bbf3ac646ec2c32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Creating volume 99163771-bc1a-425f-a111-9c7c71ccec49 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:26:08 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:26:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-99163771-bc1a-425f-a111-9c7c71ccec49 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:26:08 devstack sudo[91106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-99163771-bc1a-425f-a111-9c7c71ccec49 1073741824 Nov 03 07:26:08 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:26:09 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root Nov 03 07:26:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-99163771-bc1a-425f-a111-9c7c71ccec49 1073741824" returned: 0 in 0.626s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:26:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-99163771-bc1a-425f-a111-9c7c71ccec49 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:26:09 devstack sudo[91113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-99163771-bc1a-425f-a111-9c7c71ccec49 Nov 03 07:26:09 devstack sudo[91113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:26:10 devstack sudo[91113]: pam_unix(sudo:session): session closed for user root Nov 03 07:26:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-99163771-bc1a-425f-a111-9c7c71ccec49" returned: 0 in 0.439s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:26:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:26:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:26:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38cd58a8-ace9-4104-8c1b-f396c545dc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99163771-bc1a-425f-a111-9c7c71ccec49', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:26:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e3b6f6-e247-4645-b161-d325fe39f47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:26:10 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Volume volume-99163771-bc1a-425f-a111-9c7c71ccec49 (99163771-bc1a-425f-a111-9c7c71ccec49): created successfully Nov 03 07:26:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e3b6f6-e247-4645-b161-d325fe39f47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:26:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Flow 'volume_create_manager' (219287ad-03bf-47de-8b72-4ee8a7bc172b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:26:10 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a2e36dd4-0cc6-45e3-90f9-5e008272239c tempest-AttachVolumeNegativeTest-1666839905 None] Created volume successfully. Nov 03 07:26:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-efdb3663-648d-403b-9afb-8e006872e74d req-47e077d7-ece0-44fb-a0c0-dd66391fe1e1 tempest-AttachVolumeNegativeTest-1666839905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:26:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-efdb3663-648d-403b-9afb-8e006872e74d req-47e077d7-ece0-44fb-a0c0-dd66391fe1e1 tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:26:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-efdb3663-648d-403b-9afb-8e006872e74d req-47e077d7-ece0-44fb-a0c0-dd66391fe1e1 tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:26:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-efdb3663-648d-403b-9afb-8e006872e74d req-47e077d7-ece0-44fb-a0c0-dd66391fe1e1 tempest-AttachVolumeNegativeTest-1666839905 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14', 'name': 'volume-99163771-bc1a-425f-a111-9c7c71ccec49', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '667170a7-78c8-49c9-90ba-0c908a125bcc', 'enforce_multipath': True} {{(pid=87016) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:26:12 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-efdb3663-648d-403b-9afb-8e006872e74d req-47e077d7-ece0-44fb-a0c0-dd66391fe1e1 tempest-AttachVolumeNegativeTest-1666839905 None] attachment_update completed successfully. Nov 03 07:26:22 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:UPDATE=7,cinder:SELECT=8,cinder:INSERT=1 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:26:23 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:26:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Flow 'volume_create_manager' (bbf42106-fdad-4e19-b7b0-79c3fccf659b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:26:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef3f2e9-c700-4aaa-9460-441a0f296c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:26:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef3f2e9-c700-4aaa-9460-441a0f296c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1625990912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f40f41eb-9b37-44b9-9b17-c82ef58b5184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bcb670009574a78bd8e166c1d2f6f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:26:23Z,use_quota=True,user_id='177b0cece1a14b55b8ca274fc5368af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:26:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53354784-7880-41d5-a0c5-04bea69898c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:26:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53354784-7880-41d5-a0c5-04bea69898c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:26:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (390ddedc-ca21-46cd-9050-41fd854670b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:26:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (390ddedc-ca21-46cd-9050-41fd854670b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f40f41eb-9b37-44b9-9b17-c82ef58b5184', 'volume_name': 'volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:26:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf05c47a-a2e6-4fe7-9081-e2334efcf744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:26:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf05c47a-a2e6-4fe7-9081-e2334efcf744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:26:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e4dd402-69d9-4cdc-bf63-acf3be1a50fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:26:23 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Volume f40f41eb-9b37-44b9-9b17-c82ef58b5184: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184', 'volume_size': 1} Nov 03 07:26:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:26:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:26:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1625990912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f40f41eb-9b37-44b9-9b17-c82ef58b5184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bcb670009574a78bd8e166c1d2f6f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:26:23Z,use_quota=True,user_id='177b0cece1a14b55b8ca274fc5368af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:26:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Creating volume f40f41eb-9b37-44b9-9b17-c82ef58b5184 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:26:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:26:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:26:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:26:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:26:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:26:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:26:23 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:26:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:26:23 devstack sudo[91686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 1073741824 Nov 03 07:26:23 devstack sudo[91686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:26:25 devstack sudo[91686]: pam_unix(sudo:session): session closed for user root Nov 03 07:26:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 1073741824" returned: 0 in 1.316s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:26:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:26:25 devstack sudo[91709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 Nov 03 07:26:25 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:26:26 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root Nov 03 07:26:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184" returned: 0 in 0.778s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:26:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] <== create_volume: return (2342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:26:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.362s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:26:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e4dd402-69d9-4cdc-bf63-acf3be1a50fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:26:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57845439-0b25-48fa-bba2-9127a9b54b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:26:26 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Volume volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 (f40f41eb-9b37-44b9-9b17-c82ef58b5184): created successfully Nov 03 07:26:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57845439-0b25-48fa-bba2-9127a9b54b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:26:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Flow 'volume_create_manager' (bbf42106-fdad-4e19-b7b0-79c3fccf659b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:26:26 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-55f01da2-ec26-4858-b961-93f0ed40dcbe tempest-VolumesActionsTest-1848154357 None] Created volume successfully. Nov 03 07:26:33 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:26:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Flow 'volume_create_manager' (2c1dfe1e-482f-4b93-97cc-128c0d7043e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:26:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc8f8678-19b3-4ce2-a86f-d6df626d4121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:26:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc8f8678-19b3-4ce2-a86f-d6df626d4121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1668115077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052f46d4-51ee-466b-81d6-c76054d34ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2132d9240ca4c49a9b9e68fab064230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:26:33Z,use_quota=True,user_id='80c97ea00c154b6d8fc357db644cc78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:26:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12964ad7-8e99-44b0-bb81-83ff7510b10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:26:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12964ad7-8e99-44b0-bb81-83ff7510b10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:26:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6329969-f0a3-4833-9585-bee06b550407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:26:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6329969-f0a3-4833-9585-bee06b550407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '052f46d4-51ee-466b-81d6-c76054d34ef8', 'volume_name': 'volume-052f46d4-51ee-466b-81d6-c76054d34ef8', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:26:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c5e162-f978-47dd-8a9b-061044d94dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:26:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c5e162-f978-47dd-8a9b-061044d94dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:26:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db0ee3eb-a199-40f4-975c-1811fe7ff306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:26:33 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Volume 052f46d4-51ee-466b-81d6-c76054d34ef8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-052f46d4-51ee-466b-81d6-c76054d34ef8', 'volume_size': 1} Nov 03 07:26:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:26:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:26:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1668115077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052f46d4-51ee-466b-81d6-c76054d34ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2132d9240ca4c49a9b9e68fab064230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:26:33Z,use_quota=True,user_id='80c97ea00c154b6d8fc357db644cc78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:26:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Creating volume 052f46d4-51ee-466b-81d6-c76054d34ef8 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:26:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:26:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:26:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:26:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:26:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:26:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:26:33 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:26:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-052f46d4-51ee-466b-81d6-c76054d34ef8 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:26:33 devstack sudo[91822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-052f46d4-51ee-466b-81d6-c76054d34ef8 1073741824 Nov 03 07:26:33 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:26:34 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root Nov 03 07:26:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-052f46d4-51ee-466b-81d6-c76054d34ef8 1073741824" returned: 0 in 1.266s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:26:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-052f46d4-51ee-466b-81d6-c76054d34ef8 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:26:34 devstack sudo[91831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-052f46d4-51ee-466b-81d6-c76054d34ef8 Nov 03 07:26:34 devstack sudo[91831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:26:35 devstack sudo[91831]: pam_unix(sudo:session): session closed for user root Nov 03 07:26:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-052f46d4-51ee-466b-81d6-c76054d34ef8" returned: 0 in 0.572s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:26:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] <== create_volume: return (2020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:26:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:26:35 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db0ee3eb-a199-40f4-975c-1811fe7ff306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-052f46d4-51ee-466b-81d6-c76054d34ef8', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:26:35 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f4f176-e1e9-4cda-89e1-1e358b2679cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:26:35 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Volume volume-052f46d4-51ee-466b-81d6-c76054d34ef8 (052f46d4-51ee-466b-81d6-c76054d34ef8): created successfully Nov 03 07:26:35 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f4f176-e1e9-4cda-89e1-1e358b2679cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:26:35 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Flow 'volume_create_manager' (2c1dfe1e-482f-4b93-97cc-128c0d7043e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:26:35 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-0b930549-161b-400e-9f50-3ac8d7625d9b tempest-DeleteServersTestJSON-799234668 None] Created volume successfully. Nov 03 07:26:37 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-771068b4-191e-415d-995f-6a3fc6bf501a req-9bd3b17e-c673-4c75-b369-9dae6e8474fb tempest-ServerActionsTestOtherA-1421339689 None] Terminate volume connection completed successfully. Nov 03 07:26:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-771068b4-191e-415d-995f-6a3fc6bf501a req-9bd3b17e-c673-4c75-b369-9dae6e8474fb tempest-ServerActionsTestOtherA-1421339689 None] Deleting attachment 2e2685d6-e5f6-45a9-af20-44b0f808d897. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:26:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-0714b4ca-767c-4bb6-a350-b298328946b5 req-1c8b2184-5e1e-438a-b104-561521044417 tempest-DeleteServersTestJSON-799234668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:26:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-0714b4ca-767c-4bb6-a350-b298328946b5 req-1c8b2184-5e1e-438a-b104-561521044417 tempest-DeleteServersTestJSON-799234668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:26:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-0714b4ca-767c-4bb6-a350-b298328946b5 req-1c8b2184-5e1e-438a-b104-561521044417 tempest-DeleteServersTestJSON-799234668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:26:38 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-0714b4ca-767c-4bb6-a350-b298328946b5 req-1c8b2184-5e1e-438a-b104-561521044417 tempest-DeleteServersTestJSON-799234668 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14', 'name': 'volume-052f46d4-51ee-466b-81d6-c76054d34ef8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a317b71f-01f8-41b2-abde-90af252a248b', 'enforce_multipath': True} {{(pid=87016) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:26:38 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-0714b4ca-767c-4bb6-a350-b298328946b5 req-1c8b2184-5e1e-438a-b104-561521044417 tempest-DeleteServersTestJSON-799234668 None] attachment_update completed successfully. Nov 03 07:26:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-771068b4-191e-415d-995f-6a3fc6bf501a req-51e77042-17b7-4eec-bd5e-c25c8216c774 tempest-ServerActionsTestOtherA-1421339689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:26:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-771068b4-191e-415d-995f-6a3fc6bf501a req-51e77042-17b7-4eec-bd5e-c25c8216c774 tempest-ServerActionsTestOtherA-1421339689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:26:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-771068b4-191e-415d-995f-6a3fc6bf501a req-51e77042-17b7-4eec-bd5e-c25c8216c774 tempest-ServerActionsTestOtherA-1421339689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:26:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-771068b4-191e-415d-995f-6a3fc6bf501a req-51e77042-17b7-4eec-bd5e-c25c8216c774 tempest-ServerActionsTestOtherA-1421339689 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14', 'name': 'volume-2aa00aba-6f31-4b83-9605-5449fe27fe67', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97049775-e736-431e-859a-27e8420f626f', 'enforce_multipath': True} {{(pid=87016) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:26:42 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-771068b4-191e-415d-995f-6a3fc6bf501a req-51e77042-17b7-4eec-bd5e-c25c8216c774 tempest-ServerActionsTestOtherA-1421339689 None] attachment_update completed successfully. Nov 03 07:26:44 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-b7e0284f-40a8-4740-93af-2b623104ac56 req-aa17fae3-17d5-4c04-ba19-5a1140c7d23d tempest-DeleteServersTestJSON-799234668 None] Terminate volume connection completed successfully. Nov 03 07:26:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-b7e0284f-40a8-4740-93af-2b623104ac56 req-aa17fae3-17d5-4c04-ba19-5a1140c7d23d tempest-DeleteServersTestJSON-799234668 None] Deleting attachment a317b71f-01f8-41b2-abde-90af252a248b. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:26:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-fc3f8472-3478-45c5-a1f6-8c36835486cd tempest-DeleteServersTestJSON-799234668 None] Acquiring lock "cinder-052f46d4-51ee-466b-81d6-c76054d34ef8-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:26:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-fc3f8472-3478-45c5-a1f6-8c36835486cd tempest-DeleteServersTestJSON-799234668 None] Lock "cinder-052f46d4-51ee-466b-81d6-c76054d34ef8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:26:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-fc3f8472-3478-45c5-a1f6-8c36835486cd tempest-DeleteServersTestJSON-799234668 None] Acquiring lock "cinder-quobyte-052f46d4-51ee-466b-81d6-c76054d34ef8" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:26:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-fc3f8472-3478-45c5-a1f6-8c36835486cd tempest-DeleteServersTestJSON-799234668 None] Lock "cinder-quobyte-052f46d4-51ee-466b-81d6-c76054d34ef8" acquired by "delete_volume" :: waited 0.040s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:26:48 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[794f650c-275f-4bd5-af49-2b4be956db8d]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:26:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-fc3f8472-3478-45c5-a1f6-8c36835486cd tempest-DeleteServersTestJSON-799234668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-052f46d4-51ee-466b-81d6-c76054d34ef8 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:26:49 devstack sudo[92097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-052f46d4-51ee-466b-81d6-c76054d34ef8 Nov 03 07:26:49 devstack sudo[92097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:26:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:26:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:26:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:26:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:26:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:26:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:26:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:26:49 devstack sudo[92102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:26:49 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:26:50 devstack sudo[92097]: pam_unix(sudo:session): session closed for user root Nov 03 07:26:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-fc3f8472-3478-45c5-a1f6-8c36835486cd tempest-DeleteServersTestJSON-799234668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-052f46d4-51ee-466b-81d6-c76054d34ef8" returned: 0 in 1.510s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:26:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-fc3f8472-3478-45c5-a1f6-8c36835486cd tempest-DeleteServersTestJSON-799234668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-052f46d4-51ee-466b-81d6-c76054d34ef8 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:26:50 devstack sudo[92109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-052f46d4-51ee-466b-81d6-c76054d34ef8 Nov 03 07:26:50 devstack sudo[92109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:26:50 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root Nov 03 07:26:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 1.107s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:26:50 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:26:50 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:26:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 28 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:26:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:26:50 devstack sudo[92109]: pam_unix(sudo:session): session closed for user root Nov 03 07:26:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-fc3f8472-3478-45c5-a1f6-8c36835486cd tempest-DeleteServersTestJSON-799234668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-052f46d4-51ee-466b-81d6-c76054d34ef8" returned: 0 in 0.847s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:26:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-fc3f8472-3478-45c5-a1f6-8c36835486cd tempest-DeleteServersTestJSON-799234668 None] Lock "cinder-quobyte-052f46d4-51ee-466b-81d6-c76054d34ef8" released by "delete_volume" :: held 2.498s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:26:51 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-fc3f8472-3478-45c5-a1f6-8c36835486cd tempest-DeleteServersTestJSON-799234668 None] Created reservations ['780768a2-812e-4213-a30a-1bce7670c8c0', '4cc8aa88-f592-48a3-93be-853d29e8813d', '114804ad-aec4-443d-9f67-2cfc765afa78', 'a2a30787-525f-4edb-af4c-7fa65dcbc39d'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:26:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-fc3f8472-3478-45c5-a1f6-8c36835486cd tempest-DeleteServersTestJSON-799234668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:26:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-fc3f8472-3478-45c5-a1f6-8c36835486cd tempest-DeleteServersTestJSON-799234668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:26:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-fc3f8472-3478-45c5-a1f6-8c36835486cd tempest-DeleteServersTestJSON-799234668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:26:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-fc3f8472-3478-45c5-a1f6-8c36835486cd tempest-DeleteServersTestJSON-799234668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:26:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-fc3f8472-3478-45c5-a1f6-8c36835486cd tempest-DeleteServersTestJSON-799234668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:26:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-fc3f8472-3478-45c5-a1f6-8c36835486cd tempest-DeleteServersTestJSON-799234668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:26:51 devstack sudo[92115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:26:51 devstack sudo[92115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:26:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-922863c7-bbd6-4a53-b956-2ff8fb0cf35a tempest-VolumesActionsTest-1848154357 None] Acquiring lock "cinder-f40f41eb-9b37-44b9-9b17-c82ef58b5184" by "attach_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:26:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-922863c7-bbd6-4a53-b956-2ff8fb0cf35a tempest-VolumesActionsTest-1848154357 None] Lock "cinder-f40f41eb-9b37-44b9-9b17-c82ef58b5184" acquired by "attach_volume" :: waited 0.066s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:26:51 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-922863c7-bbd6-4a53-b956-2ff8fb0cf35a tempest-VolumesActionsTest-1848154357 None] Attaching volume f40f41eb-9b37-44b9-9b17-c82ef58b5184 to instance 82d031b9-1df8-43c2-922b-d0103df9a5cb at mountpoint /dev/vdb on host None. Nov 03 07:26:51 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-922863c7-bbd6-4a53-b956-2ff8fb0cf35a tempest-VolumesActionsTest-1848154357 None] Attach volume completed successfully. Nov 03 07:26:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-922863c7-bbd6-4a53-b956-2ff8fb0cf35a tempest-VolumesActionsTest-1848154357 None] Lock "cinder-f40f41eb-9b37-44b9-9b17-c82ef58b5184" released by "attach_volume" :: held 0.294s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:26:52 devstack sudo[92115]: pam_unix(sudo:session): session closed for user root Nov 03 07:26:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-fc3f8472-3478-45c5-a1f6-8c36835486cd tempest-DeleteServersTestJSON-799234668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.736s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:26:52 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-fc3f8472-3478-45c5-a1f6-8c36835486cd tempest-DeleteServersTestJSON-799234668 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:26:52 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-fc3f8472-3478-45c5-a1f6-8c36835486cd tempest-DeleteServersTestJSON-799234668 None] Deleted volume successfully. Nov 03 07:26:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f44a1ea1-4843-4e37-8b18-c318d988c9fa tempest-VolumesActionsTest-1848154357 None] Acquiring lock "cinder-f40f41eb-9b37-44b9-9b17-c82ef58b5184-detach_volume" by "detach_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:26:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-fc3f8472-3478-45c5-a1f6-8c36835486cd tempest-DeleteServersTestJSON-799234668 None] Lock "cinder-052f46d4-51ee-466b-81d6-c76054d34ef8-delete_volume" released by "delete_volume" :: held 3.895s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:26:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f44a1ea1-4843-4e37-8b18-c318d988c9fa tempest-VolumesActionsTest-1848154357 None] Lock "cinder-f40f41eb-9b37-44b9-9b17-c82ef58b5184-detach_volume" acquired by "detach_volume" :: waited 0.070s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:26:52 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-f44a1ea1-4843-4e37-8b18-c318d988c9fa tempest-VolumesActionsTest-1848154357 None] Detaching volume f40f41eb-9b37-44b9-9b17-c82ef58b5184 from instance 82d031b9-1df8-43c2-922b-d0103df9a5cb. Nov 03 07:26:52 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-f44a1ea1-4843-4e37-8b18-c318d988c9fa tempest-VolumesActionsTest-1848154357 None] Detach volume completed successfully. Nov 03 07:26:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f44a1ea1-4843-4e37-8b18-c318d988c9fa tempest-VolumesActionsTest-1848154357 None] Lock "cinder-f40f41eb-9b37-44b9-9b17-c82ef58b5184-detach_volume" released by "detach_volume" :: held 0.263s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:27:02 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=37,cinder:UPDATE=28,cinder:DELETE=4,cinder:INSERT=2 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:27:02 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=34,cinder:UPDATE=15,cinder:INSERT=6 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:27:11 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b7773756-948d-450b-9a55-09535d46692a tempest-VolumesActionsTest-1848154357 None] Acquiring lock "cinder-f40f41eb-9b37-44b9-9b17-c82ef58b5184" by "attach_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:27:11 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b7773756-948d-450b-9a55-09535d46692a tempest-VolumesActionsTest-1848154357 None] Lock "cinder-f40f41eb-9b37-44b9-9b17-c82ef58b5184" acquired by "attach_volume" :: waited 0.032s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:27:11 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b7773756-948d-450b-9a55-09535d46692a tempest-VolumesActionsTest-1848154357 None] Attaching volume f40f41eb-9b37-44b9-9b17-c82ef58b5184 to instance 32d2affb-e3b3-4762-80dc-4e0dfd4e30d9 at mountpoint /dev/vdb on host None. Nov 03 07:27:11 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b7773756-948d-450b-9a55-09535d46692a tempest-VolumesActionsTest-1848154357 None] Attach volume completed successfully. Nov 03 07:27:11 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b7773756-948d-450b-9a55-09535d46692a tempest-VolumesActionsTest-1848154357 None] Lock "cinder-f40f41eb-9b37-44b9-9b17-c82ef58b5184" released by "attach_volume" :: held 0.176s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:27:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-df962a44-3b44-4c7e-b07e-57244a3a8cf9 tempest-VolumesActionsTest-1848154357 None] Acquiring lock "cinder-f40f41eb-9b37-44b9-9b17-c82ef58b5184-detach_volume" by "detach_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:27:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-df962a44-3b44-4c7e-b07e-57244a3a8cf9 tempest-VolumesActionsTest-1848154357 None] Lock "cinder-f40f41eb-9b37-44b9-9b17-c82ef58b5184-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:27:12 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-df962a44-3b44-4c7e-b07e-57244a3a8cf9 tempest-VolumesActionsTest-1848154357 None] Detaching volume f40f41eb-9b37-44b9-9b17-c82ef58b5184 from instance 32d2affb-e3b3-4762-80dc-4e0dfd4e30d9. Nov 03 07:27:12 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-df962a44-3b44-4c7e-b07e-57244a3a8cf9 tempest-VolumesActionsTest-1848154357 None] Detach volume completed successfully. Nov 03 07:27:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-df962a44-3b44-4c7e-b07e-57244a3a8cf9 tempest-VolumesActionsTest-1848154357 None] Lock "cinder-f40f41eb-9b37-44b9-9b17-c82ef58b5184-detach_volume" released by "detach_volume" :: held 0.176s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:27:21 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-54ed82c4-7694-417a-9c56-4dc1db9a8b44 req-a77c008e-f8af-46e2-8284-4eb057389da5 tempest-AttachVolumeNegativeTest-1666839905 None] Terminate volume connection completed successfully. Nov 03 07:27:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-54ed82c4-7694-417a-9c56-4dc1db9a8b44 req-a77c008e-f8af-46e2-8284-4eb057389da5 tempest-AttachVolumeNegativeTest-1666839905 None] Deleting attachment 667170a7-78c8-49c9-90ba-0c908a125bcc. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:27:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-516147af-49a6-41a5-a6fd-ce96c7762e83 tempest-VolumesActionsTest-1848154357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:27:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-516147af-49a6-41a5-a6fd-ce96c7762e83 tempest-VolumesActionsTest-1848154357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:27:23 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afe429f-3b6b-4052-8803-02954d1f3f4b]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:27:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-516147af-49a6-41a5-a6fd-ce96c7762e83 tempest-VolumesActionsTest-1848154357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:27:23 devstack sudo[92415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 Nov 03 07:27:23 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:27:24 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root Nov 03 07:27:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-516147af-49a6-41a5-a6fd-ce96c7762e83 tempest-VolumesActionsTest-1848154357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184" returned: 0 in 0.527s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:27:24 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d1b14a-7969-4f2a-ac8a-e21a1addf0f9]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:27:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-516147af-49a6-41a5-a6fd-ce96c7762e83 tempest-VolumesActionsTest-1848154357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:27:24 devstack sudo[92420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 Nov 03 07:27:24 devstack sudo[92420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:27:24 devstack sudo[92420]: pam_unix(sudo:session): session closed for user root Nov 03 07:27:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-516147af-49a6-41a5-a6fd-ce96c7762e83 tempest-VolumesActionsTest-1848154357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184" returned: 0 in 0.469s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:27:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-516147af-49a6-41a5-a6fd-ce96c7762e83 tempest-VolumesActionsTest-1848154357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 /opt/stack/data/cinder/conversion/f40f41eb-9b37-44b9-9b17-c82ef58b5184.temp_image.e1216276-1e54-47bb-bee2-7737d59f17f412j3ed0o.img {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:27:24 devstack sudo[92429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 /opt/stack/data/cinder/conversion/f40f41eb-9b37-44b9-9b17-c82ef58b5184.temp_image.e1216276-1e54-47bb-bee2-7737d59f17f412j3ed0o.img Nov 03 07:27:24 devstack sudo[92429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:27:30 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-b3c36f49-a09b-46b8-afef-773911bc0258 req-af5540b5-d572-4e4b-8cf0-19c6f0990941 tempest-ServerActionsTestOtherA-1421339689 None] Terminate volume connection completed successfully. Nov 03 07:27:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-b3c36f49-a09b-46b8-afef-773911bc0258 req-af5540b5-d572-4e4b-8cf0-19c6f0990941 tempest-ServerActionsTestOtherA-1421339689 None] Deleting attachment 97049775-e736-431e-859a-27e8420f626f. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:27:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-b3c36f49-a09b-46b8-afef-773911bc0258 req-44a00ce2-425f-4ac8-be1a-4da161e32c33 tempest-ServerActionsTestOtherA-1421339689 None] Acquiring lock "cinder-2aa00aba-6f31-4b83-9605-5449fe27fe67-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:27:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-b3c36f49-a09b-46b8-afef-773911bc0258 req-44a00ce2-425f-4ac8-be1a-4da161e32c33 tempest-ServerActionsTestOtherA-1421339689 None] Lock "cinder-2aa00aba-6f31-4b83-9605-5449fe27fe67-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:27:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-b3c36f49-a09b-46b8-afef-773911bc0258 req-44a00ce2-425f-4ac8-be1a-4da161e32c33 tempest-ServerActionsTestOtherA-1421339689 None] Acquiring lock "cinder-quobyte-2aa00aba-6f31-4b83-9605-5449fe27fe67" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:27:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-b3c36f49-a09b-46b8-afef-773911bc0258 req-44a00ce2-425f-4ac8-be1a-4da161e32c33 tempest-ServerActionsTestOtherA-1421339689 None] Lock "cinder-quobyte-2aa00aba-6f31-4b83-9605-5449fe27fe67" acquired by "delete_volume" :: waited 0.052s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:27:31 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c739e1-7846-44e6-8130-7df50cf69a8c]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:27:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-b3c36f49-a09b-46b8-afef-773911bc0258 req-44a00ce2-425f-4ac8-be1a-4da161e32c33 tempest-ServerActionsTestOtherA-1421339689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2aa00aba-6f31-4b83-9605-5449fe27fe67 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:27:31 devstack sudo[92475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2aa00aba-6f31-4b83-9605-5449fe27fe67 Nov 03 07:27:31 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:27:32 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root Nov 03 07:27:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-b3c36f49-a09b-46b8-afef-773911bc0258 req-44a00ce2-425f-4ac8-be1a-4da161e32c33 tempest-ServerActionsTestOtherA-1421339689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2aa00aba-6f31-4b83-9605-5449fe27fe67" returned: 0 in 1.093s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:27:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-b3c36f49-a09b-46b8-afef-773911bc0258 req-44a00ce2-425f-4ac8-be1a-4da161e32c33 tempest-ServerActionsTestOtherA-1421339689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2aa00aba-6f31-4b83-9605-5449fe27fe67 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:27:32 devstack sudo[92483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2aa00aba-6f31-4b83-9605-5449fe27fe67 Nov 03 07:27:32 devstack sudo[92483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:27:32 devstack sudo[92483]: pam_unix(sudo:session): session closed for user root Nov 03 07:27:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-b3c36f49-a09b-46b8-afef-773911bc0258 req-44a00ce2-425f-4ac8-be1a-4da161e32c33 tempest-ServerActionsTestOtherA-1421339689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2aa00aba-6f31-4b83-9605-5449fe27fe67" returned: 0 in 0.542s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:27:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-b3c36f49-a09b-46b8-afef-773911bc0258 req-44a00ce2-425f-4ac8-be1a-4da161e32c33 tempest-ServerActionsTestOtherA-1421339689 None] Lock "cinder-quobyte-2aa00aba-6f31-4b83-9605-5449fe27fe67" released by "delete_volume" :: held 1.804s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:27:33 devstack cinder-volume[87016]: DEBUG cinder.quota [req-b3c36f49-a09b-46b8-afef-773911bc0258 req-44a00ce2-425f-4ac8-be1a-4da161e32c33 tempest-ServerActionsTestOtherA-1421339689 None] Created reservations ['453847ab-fb3e-4a7b-96f3-538ec5ad8361', '8491e279-6795-41a4-ab80-9400d816cdf2', '00201e0e-29fa-4390-92e7-ae23ff393a1b', 'c0abf820-90c1-4fe0-97eb-09c3bc79eb67'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:27:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-b3c36f49-a09b-46b8-afef-773911bc0258 req-44a00ce2-425f-4ac8-be1a-4da161e32c33 tempest-ServerActionsTestOtherA-1421339689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:27:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-b3c36f49-a09b-46b8-afef-773911bc0258 req-44a00ce2-425f-4ac8-be1a-4da161e32c33 tempest-ServerActionsTestOtherA-1421339689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:27:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [req-b3c36f49-a09b-46b8-afef-773911bc0258 req-44a00ce2-425f-4ac8-be1a-4da161e32c33 tempest-ServerActionsTestOtherA-1421339689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:27:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [req-b3c36f49-a09b-46b8-afef-773911bc0258 req-44a00ce2-425f-4ac8-be1a-4da161e32c33 tempest-ServerActionsTestOtherA-1421339689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:27:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-b3c36f49-a09b-46b8-afef-773911bc0258 req-44a00ce2-425f-4ac8-be1a-4da161e32c33 tempest-ServerActionsTestOtherA-1421339689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:27:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-b3c36f49-a09b-46b8-afef-773911bc0258 req-44a00ce2-425f-4ac8-be1a-4da161e32c33 tempest-ServerActionsTestOtherA-1421339689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:27:33 devstack sudo[92486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:27:33 devstack sudo[92486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:27:33 devstack sudo[92486]: pam_unix(sudo:session): session closed for user root Nov 03 07:27:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-b3c36f49-a09b-46b8-afef-773911bc0258 req-44a00ce2-425f-4ac8-be1a-4da161e32c33 tempest-ServerActionsTestOtherA-1421339689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.613s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:27:33 devstack cinder-volume[87016]: DEBUG cinder.manager [req-b3c36f49-a09b-46b8-afef-773911bc0258 req-44a00ce2-425f-4ac8-be1a-4da161e32c33 tempest-ServerActionsTestOtherA-1421339689 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:27:33 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-b3c36f49-a09b-46b8-afef-773911bc0258 req-44a00ce2-425f-4ac8-be1a-4da161e32c33 tempest-ServerActionsTestOtherA-1421339689 None] Deleted volume successfully. Nov 03 07:27:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-b3c36f49-a09b-46b8-afef-773911bc0258 req-44a00ce2-425f-4ac8-be1a-4da161e32c33 tempest-ServerActionsTestOtherA-1421339689 None] Lock "cinder-2aa00aba-6f31-4b83-9605-5449fe27fe67-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:27:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-65502263-4508-4abf-8e45-5f9c5c137dd6 tempest-ServerActionsTestOtherA-1421339689 None] Acquiring lock "cinder-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:27:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-65502263-4508-4abf-8e45-5f9c5c137dd6 tempest-ServerActionsTestOtherA-1421339689 None] Lock "cinder-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:27:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-65502263-4508-4abf-8e45-5f9c5c137dd6 tempest-ServerActionsTestOtherA-1421339689 None] Acquiring lock "cinder-quobyte-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:27:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-65502263-4508-4abf-8e45-5f9c5c137dd6 tempest-ServerActionsTestOtherA-1421339689 None] Lock "cinder-quobyte-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f" acquired by "delete_volume" :: waited 0.065s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:27:34 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb2f35b-1521-4c95-8791-187c18297333]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:27:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-65502263-4508-4abf-8e45-5f9c5c137dd6 tempest-ServerActionsTestOtherA-1421339689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:27:34 devstack sudo[92490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f Nov 03 07:27:34 devstack sudo[92490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:27:34 devstack sudo[92429]: pam_unix(sudo:session): session closed for user root Nov 03 07:27:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-516147af-49a6-41a5-a6fd-ce96c7762e83 tempest-VolumesActionsTest-1848154357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 /opt/stack/data/cinder/conversion/f40f41eb-9b37-44b9-9b17-c82ef58b5184.temp_image.e1216276-1e54-47bb-bee2-7737d59f17f412j3ed0o.img" returned: 0 in 9.879s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:27:34 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5d4b12-2cc0-4e67-b90c-6d904ff81be1]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:27:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-516147af-49a6-41a5-a6fd-ce96c7762e83 tempest-VolumesActionsTest-1848154357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:27:34 devstack sudo[92492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 Nov 03 07:27:34 devstack sudo[92492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:27:35 devstack sudo[92490]: pam_unix(sudo:session): session closed for user root Nov 03 07:27:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-65502263-4508-4abf-8e45-5f9c5c137dd6 tempest-ServerActionsTestOtherA-1421339689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f" returned: 0 in 0.665s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:27:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-65502263-4508-4abf-8e45-5f9c5c137dd6 tempest-ServerActionsTestOtherA-1421339689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:27:35 devstack sudo[92497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f Nov 03 07:27:35 devstack sudo[92497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:27:35 devstack sudo[92497]: pam_unix(sudo:session): session closed for user root Nov 03 07:27:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-65502263-4508-4abf-8e45-5f9c5c137dd6 tempest-ServerActionsTestOtherA-1421339689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f" returned: 0 in 0.343s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:27:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-65502263-4508-4abf-8e45-5f9c5c137dd6 tempest-ServerActionsTestOtherA-1421339689 None] Lock "cinder-quobyte-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f" released by "delete_volume" :: held 1.119s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:27:35 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-65502263-4508-4abf-8e45-5f9c5c137dd6 tempest-ServerActionsTestOtherA-1421339689 None] Created reservations ['f41a4c9d-7708-465b-b3ce-15a257e3d1a2', 'fb93397f-9769-4e87-8d7c-68ceb7e764f0', 'eee728ae-b668-45dd-b91e-d9dab4c5321b', '56d8f57a-10cb-4025-9f19-159e36735b0d'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:27:35 devstack sudo[92492]: pam_unix(sudo:session): session closed for user root Nov 03 07:27:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-516147af-49a6-41a5-a6fd-ce96c7762e83 tempest-VolumesActionsTest-1848154357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184" returned: 0 in 0.963s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:27:35 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-516147af-49a6-41a5-a6fd-ce96c7762e83 tempest-VolumesActionsTest-1848154357 None] Image conversion details: src /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184, size 1024.00 MB, duration 9.88 sec, destination /opt/stack/data/cinder/conversion/f40f41eb-9b37-44b9-9b17-c82ef58b5184.temp_image.e1216276-1e54-47bb-bee2-7737d59f17f412j3ed0o.img {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:27:35 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-516147af-49a6-41a5-a6fd-ce96c7762e83 tempest-VolumesActionsTest-1848154357 None] Converted 1024.00 MB image at 103.63 MB/s Nov 03 07:27:35 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-516147af-49a6-41a5-a6fd-ce96c7762e83 tempest-VolumesActionsTest-1848154357 None] e1216276-1e54-47bb-bee2-7737d59f17f4 was raw, no need to convert to raw {{(pid=87016) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 07:27:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-65502263-4508-4abf-8e45-5f9c5c137dd6 tempest-ServerActionsTestOtherA-1421339689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:27:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-65502263-4508-4abf-8e45-5f9c5c137dd6 tempest-ServerActionsTestOtherA-1421339689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:27:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-65502263-4508-4abf-8e45-5f9c5c137dd6 tempest-ServerActionsTestOtherA-1421339689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:27:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-65502263-4508-4abf-8e45-5f9c5c137dd6 tempest-ServerActionsTestOtherA-1421339689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:27:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-65502263-4508-4abf-8e45-5f9c5c137dd6 tempest-ServerActionsTestOtherA-1421339689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:27:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-65502263-4508-4abf-8e45-5f9c5c137dd6 tempest-ServerActionsTestOtherA-1421339689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:27:35 devstack sudo[92515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:27:35 devstack sudo[92515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:27:36 devstack sudo[92515]: pam_unix(sudo:session): session closed for user root Nov 03 07:27:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-65502263-4508-4abf-8e45-5f9c5c137dd6 tempest-ServerActionsTestOtherA-1421339689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.391s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:27:36 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-65502263-4508-4abf-8e45-5f9c5c137dd6 tempest-ServerActionsTestOtherA-1421339689 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:27:36 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-65502263-4508-4abf-8e45-5f9c5c137dd6 tempest-ServerActionsTestOtherA-1421339689 None] Deleted volume successfully. Nov 03 07:27:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-65502263-4508-4abf-8e45-5f9c5c137dd6 tempest-ServerActionsTestOtherA-1421339689 None] Lock "cinder-7b95fb3c-6814-48f6-a6e6-3ff3b4af7b9f-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:27:45 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:INSERT=6,cinder:SELECT=14,cinder:UPDATE=23 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:27:46 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=26,cinder:UPDATE=15,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:27:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:27:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:27:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:27:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:27:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:27:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:27:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:27:49 devstack sudo[92715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:27:49 devstack sudo[92715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:27:50 devstack sudo[92715]: pam_unix(sudo:session): session closed for user root Nov 03 07:27:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 1.000s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:27:50 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:27:50 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:27:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 28 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:27:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:28:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-516147af-49a6-41a5-a6fd-ce96c7762e83 tempest-VolumesActionsTest-1848154357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 47.280s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-516147af-49a6-41a5-a6fd-ce96c7762e83 tempest-VolumesActionsTest-1848154357 None] Uploaded volume to glance image-id: e1216276-1e54-47bb-bee2-7737d59f17f4. {{(pid=87016) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 07:28:10 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-516147af-49a6-41a5-a6fd-ce96c7762e83 tempest-VolumesActionsTest-1848154357 None] Copy volume to image completed successfully. Nov 03 07:28:11 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:28:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Flow 'volume_create_manager' (ae684988-6c3d-44c1-b73b-85c01a13b10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:28:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08abe36c-35ce-40ba-946b-4176bafcd50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08abe36c-35ce-40ba-946b-4176bafcd50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2003557459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de21125-8feb-43c2-8702-580e7d478842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d9c6ad92dc4643b180454c71b66f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:28:11Z,use_quota=True,user_id='f7e5900c8e6441d9a0151903328beea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b65232-825a-48ef-b724-5a6a5cb3d456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b65232-825a-48ef-b724-5a6a5cb3d456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6845a3d4-34e6-402e-922a-cc02dcf17e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6845a3d4-34e6-402e-922a-cc02dcf17e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9de21125-8feb-43c2-8702-580e7d478842', 'volume_name': 'volume-9de21125-8feb-43c2-8702-580e7d478842', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d989b293-939e-44e6-addc-5097879d0913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d989b293-939e-44e6-addc-5097879d0913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d3fa5e-0f7b-49ef-ab6e-88a4f1527bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:11 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Volume 9de21125-8feb-43c2-8702-580e7d478842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9de21125-8feb-43c2-8702-580e7d478842', 'volume_size': 1} Nov 03 07:28:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:11 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2003557459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de21125-8feb-43c2-8702-580e7d478842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d9c6ad92dc4643b180454c71b66f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:28:11Z,use_quota=True,user_id='f7e5900c8e6441d9a0151903328beea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:28:11 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Creating volume 9de21125-8feb-43c2-8702-580e7d478842 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:28:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:11 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:28:11 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:28:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:11 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:28:11 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:28:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9de21125-8feb-43c2-8702-580e7d478842 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:11 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9de21125-8feb-43c2-8702-580e7d478842 1073741824 Nov 03 07:28:11 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:12 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9de21125-8feb-43c2-8702-580e7d478842 1073741824" returned: 0 in 0.743s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9de21125-8feb-43c2-8702-580e7d478842 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:12 devstack sudo[92820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9de21125-8feb-43c2-8702-580e7d478842 Nov 03 07:28:12 devstack sudo[92820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:12 devstack sudo[92820]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9de21125-8feb-43c2-8702-580e7d478842" returned: 0 in 0.313s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:28:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d3fa5e-0f7b-49ef-ab6e-88a4f1527bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9de21125-8feb-43c2-8702-580e7d478842', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d019e7c-9254-4537-9a0f-a89eff5fe808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:12 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Volume volume-9de21125-8feb-43c2-8702-580e7d478842 (9de21125-8feb-43c2-8702-580e7d478842): created successfully Nov 03 07:28:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d019e7c-9254-4537-9a0f-a89eff5fe808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Flow 'volume_create_manager' (ae684988-6c3d-44c1-b73b-85c01a13b10b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:28:12 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b5dce904-2c1a-4e44-b508-b6fee4b8135b tempest-AttachVolumeTestJSON-654495122 None] Created volume successfully. Nov 03 07:28:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:12 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dfd464-c258-447f-b0f8-3ee54773f289]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:28:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:12 devstack sudo[92823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 Nov 03 07:28:12 devstack sudo[92823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:13 devstack sudo[92823]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184" returned: 0 in 0.602s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:13 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a665de7-8c25-416e-b4e9-b1787ec484e6]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:28:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:13 devstack sudo[92828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 Nov 03 07:28:13 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:14 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184" returned: 0 in 0.628s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 /opt/stack/data/cinder/conversion/f40f41eb-9b37-44b9-9b17-c82ef58b5184.temp_image.49f38786-328e-4889-ba11-2e05a98494a3phwauqg7.img {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:14 devstack sudo[92875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 /opt/stack/data/cinder/conversion/f40f41eb-9b37-44b9-9b17-c82ef58b5184.temp_image.49f38786-328e-4889-ba11-2e05a98494a3phwauqg7.img Nov 03 07:28:14 devstack sudo[92875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:15 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:28:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Flow 'volume_create_manager' (8af3dc99-9b1d-4bc4-9bfa-a7e0f75ae246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:28:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925d091b-082a-4a18-acfd-dfb752b9179c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925d091b-082a-4a18-acfd-dfb752b9179c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-945715621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c30be9-2289-4886-b80d-d71e1ada24d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485c1b2e7e034556a572fe1555b9437f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:28:15Z,use_quota=True,user_id='3915baa0841c4d00bbf3ac646ec2c32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3316898-392b-4380-bd49-bf894dc49593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3316898-392b-4380-bd49-bf894dc49593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf461bf-f932-4f8b-9fd6-3161ba298d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf461bf-f932-4f8b-9fd6-3161ba298d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68c30be9-2289-4886-b80d-d71e1ada24d2', 'volume_name': 'volume-68c30be9-2289-4886-b80d-d71e1ada24d2', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f47e6b-125c-4153-ace0-d41522fc4c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f47e6b-125c-4153-ace0-d41522fc4c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4022cc6-9263-4f0e-a04e-df31110b2392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:15 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Volume 68c30be9-2289-4886-b80d-d71e1ada24d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68c30be9-2289-4886-b80d-d71e1ada24d2', 'volume_size': 1} Nov 03 07:28:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-ac2cd032-8f6c-4a68-8c2d-bd52f5060524 req-67339130-84c4-4e2f-a7c8-331f9c21ff93 tempest-AttachVolumeTestJSON-654495122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:22 devstack sudo[92875]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 /opt/stack/data/cinder/conversion/f40f41eb-9b37-44b9-9b17-c82ef58b5184.temp_image.49f38786-328e-4889-ba11-2e05a98494a3phwauqg7.img" returned: 0 in 8.795s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:22 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cec126a-bee4-48f9-bef8-5603dc33a952]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:28:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:22 devstack sudo[92921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 Nov 03 07:28:22 devstack sudo[92921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:23 devstack sudo[92921]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184" returned: 0 in 0.648s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:23 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] Image conversion details: src /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184, size 1024.00 MB, duration 8.80 sec, destination /opt/stack/data/cinder/conversion/f40f41eb-9b37-44b9-9b17-c82ef58b5184.temp_image.49f38786-328e-4889-ba11-2e05a98494a3phwauqg7.img {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:28:23 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] Converted 1024.00 MB image at 116.42 MB/s Nov 03 07:28:23 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] 49f38786-328e-4889-ba11-2e05a98494a3 was raw, converting to qcow2 {{(pid=87016) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 03 07:28:23 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3dd733-5ea5-4b58-9b8e-ce1cf6ee437f]: (4, 'raw') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:28:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f40f41eb-9b37-44b9-9b17-c82ef58b5184.temp_image.49f38786-328e-4889-ba11-2e05a98494a3phwauqg7.img {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:23 devstack sudo[92929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f40f41eb-9b37-44b9-9b17-c82ef58b5184.temp_image.49f38786-328e-4889-ba11-2e05a98494a3phwauqg7.img Nov 03 07:28:23 devstack sudo[92929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:23 devstack sudo[92929]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f40f41eb-9b37-44b9-9b17-c82ef58b5184.temp_image.49f38786-328e-4889-ba11-2e05a98494a3phwauqg7.img" returned: 0 in 0.423s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f40f41eb-9b37-44b9-9b17-c82ef58b5184.temp_image.49f38786-328e-4889-ba11-2e05a98494a3phwauqg7.img {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:24 devstack sudo[92933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f40f41eb-9b37-44b9-9b17-c82ef58b5184.temp_image.49f38786-328e-4889-ba11-2e05a98494a3phwauqg7.img Nov 03 07:28:24 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:24 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f40f41eb-9b37-44b9-9b17-c82ef58b5184.temp_image.49f38786-328e-4889-ba11-2e05a98494a3phwauqg7.img" returned: 1 in 0.429s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f40f41eb-9b37-44b9-9b17-c82ef58b5184.temp_image.49f38786-328e-4889-ba11-2e05a98494a3phwauqg7.img' failed. Not Retrying. {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:28:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f40f41eb-9b37-44b9-9b17-c82ef58b5184.temp_image.49f38786-328e-4889-ba11-2e05a98494a3phwauqg7.img /opt/stack/data/cinder/conversion/vol_upload_atpfno9c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:24 devstack sudo[92942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f40f41eb-9b37-44b9-9b17-c82ef58b5184.temp_image.49f38786-328e-4889-ba11-2e05a98494a3phwauqg7.img /opt/stack/data/cinder/conversion/vol_upload_atpfno9c Nov 03 07:28:24 devstack sudo[92942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:24 devstack sudo[92942]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f40f41eb-9b37-44b9-9b17-c82ef58b5184.temp_image.49f38786-328e-4889-ba11-2e05a98494a3phwauqg7.img /opt/stack/data/cinder/conversion/vol_upload_atpfno9c" returned: 0 in 0.322s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:24 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] Image conversion details: src /opt/stack/data/cinder/conversion/f40f41eb-9b37-44b9-9b17-c82ef58b5184.temp_image.49f38786-328e-4889-ba11-2e05a98494a3phwauqg7.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_atpfno9c {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:28:24 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 03 07:28:24 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5b8998-7ae0-4b13-9a1c-d95f7ea56c2e]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:28:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_atpfno9c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:24 devstack sudo[92948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_atpfno9c Nov 03 07:28:24 devstack sudo[92948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:25 devstack sudo[92948]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_atpfno9c" returned: 0 in 0.469s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.777s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] Uploaded volume to glance image-id: 49f38786-328e-4889-ba11-2e05a98494a3. {{(pid=87016) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 07:28:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.902s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-945715621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c30be9-2289-4886-b80d-d71e1ada24d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485c1b2e7e034556a572fe1555b9437f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:28:15Z,use_quota=True,user_id='3915baa0841c4d00bbf3ac646ec2c32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:28:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Creating volume 68c30be9-2289-4886-b80d-d71e1ada24d2 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:28:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:28:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:28:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:28:27 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:28:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-68c30be9-2289-4886-b80d-d71e1ada24d2 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:27 devstack sudo[92990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-68c30be9-2289-4886-b80d-d71e1ada24d2 1073741824 Nov 03 07:28:27 devstack sudo[92990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:27 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-5c3ddfbb-3af7-44f3-82f8-225032d40c9e tempest-VolumesActionsTest-1848154357 None] Copy volume to image completed successfully. Nov 03 07:28:28 devstack sudo[92990]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-68c30be9-2289-4886-b80d-d71e1ada24d2 1073741824" returned: 0 in 0.740s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-68c30be9-2289-4886-b80d-d71e1ada24d2 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:28 devstack sudo[92999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-68c30be9-2289-4886-b80d-d71e1ada24d2 Nov 03 07:28:28 devstack sudo[92999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:28 devstack sudo[92999]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-68c30be9-2289-4886-b80d-d71e1ada24d2" returned: 0 in 0.430s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:28:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-ac2cd032-8f6c-4a68-8c2d-bd52f5060524 req-67339130-84c4-4e2f-a7c8-331f9c21ff93 tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.888s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-ac2cd032-8f6c-4a68-8c2d-bd52f5060524 req-67339130-84c4-4e2f-a7c8-331f9c21ff93 tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4022cc6-9263-4f0e-a04e-df31110b2392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68c30be9-2289-4886-b80d-d71e1ada24d2', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a71d37ad-576a-4f26-b17f-90dc42a3b377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:28 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-599dca2a-f5ae-403e-88e0-89075926ba81 tempest-VolumesActionsTest-1848154357 None] Acquiring lock "cinder-f40f41eb-9b37-44b9-9b17-c82ef58b5184-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:28:28 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Volume volume-68c30be9-2289-4886-b80d-d71e1ada24d2 (68c30be9-2289-4886-b80d-d71e1ada24d2): created successfully Nov 03 07:28:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a71d37ad-576a-4f26-b17f-90dc42a3b377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Flow 'volume_create_manager' (8af3dc99-9b1d-4bc4-9bfa-a7e0f75ae246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:28:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-599dca2a-f5ae-403e-88e0-89075926ba81 tempest-VolumesActionsTest-1848154357 None] Lock "cinder-f40f41eb-9b37-44b9-9b17-c82ef58b5184-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:28:29 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-93a820ba-4622-4938-86f4-05669cfc8e99 tempest-AttachVolumeNegativeTest-1666839905 None] Created volume successfully. Nov 03 07:28:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-ac2cd032-8f6c-4a68-8c2d-bd52f5060524 req-67339130-84c4-4e2f-a7c8-331f9c21ff93 tempest-AttachVolumeTestJSON-654495122 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14', 'name': 'volume-9de21125-8feb-43c2-8702-580e7d478842', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd021afa0-88e5-45ea-bea1-a8e52431a835', 'enforce_multipath': True} {{(pid=87016) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:28:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-599dca2a-f5ae-403e-88e0-89075926ba81 tempest-VolumesActionsTest-1848154357 None] Acquiring lock "cinder-quobyte-f40f41eb-9b37-44b9-9b17-c82ef58b5184" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:28:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-599dca2a-f5ae-403e-88e0-89075926ba81 tempest-VolumesActionsTest-1848154357 None] Lock "cinder-quobyte-f40f41eb-9b37-44b9-9b17-c82ef58b5184" acquired by "delete_volume" :: waited 0.039s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:28:29 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-ac2cd032-8f6c-4a68-8c2d-bd52f5060524 req-67339130-84c4-4e2f-a7c8-331f9c21ff93 tempest-AttachVolumeTestJSON-654495122 None] attachment_update completed successfully. Nov 03 07:28:29 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddb2071-1894-49c4-b15d-969ce22fdd43]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:28:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-599dca2a-f5ae-403e-88e0-89075926ba81 tempest-VolumesActionsTest-1848154357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:29 devstack sudo[93043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 Nov 03 07:28:29 devstack sudo[93043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:30 devstack sudo[93043]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-599dca2a-f5ae-403e-88e0-89075926ba81 tempest-VolumesActionsTest-1848154357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184" returned: 0 in 1.053s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-599dca2a-f5ae-403e-88e0-89075926ba81 tempest-VolumesActionsTest-1848154357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:30 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184 Nov 03 07:28:30 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:31 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-599dca2a-f5ae-403e-88e0-89075926ba81 tempest-VolumesActionsTest-1848154357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f40f41eb-9b37-44b9-9b17-c82ef58b5184" returned: 0 in 0.603s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-599dca2a-f5ae-403e-88e0-89075926ba81 tempest-VolumesActionsTest-1848154357 None] Lock "cinder-quobyte-f40f41eb-9b37-44b9-9b17-c82ef58b5184" released by "delete_volume" :: held 1.789s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:28:31 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-599dca2a-f5ae-403e-88e0-89075926ba81 tempest-VolumesActionsTest-1848154357 None] Created reservations ['e0b67aef-b4c8-4bc0-9165-f1a5e57a8926', 'c808fdc8-f7f7-4f8e-83f6-fdcf953964b8', '6f2ab289-992d-45ae-8122-fc07c9ae78ad', 'f1016a5c-e7ba-4ec1-9647-2114689e72d0'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:28:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-599dca2a-f5ae-403e-88e0-89075926ba81 tempest-VolumesActionsTest-1848154357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-599dca2a-f5ae-403e-88e0-89075926ba81 tempest-VolumesActionsTest-1848154357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:31 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-599dca2a-f5ae-403e-88e0-89075926ba81 tempest-VolumesActionsTest-1848154357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:28:31 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-599dca2a-f5ae-403e-88e0-89075926ba81 tempest-VolumesActionsTest-1848154357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:28:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-599dca2a-f5ae-403e-88e0-89075926ba81 tempest-VolumesActionsTest-1848154357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-599dca2a-f5ae-403e-88e0-89075926ba81 tempest-VolumesActionsTest-1848154357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:31 devstack sudo[93506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:28:31 devstack sudo[93506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-311bd127-36aa-4996-a952-2a695b03dca0 req-22709276-b7e7-4f8f-a9d2-f11c8ff78ea7 tempest-AttachVolumeNegativeTest-1666839905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-311bd127-36aa-4996-a952-2a695b03dca0 req-22709276-b7e7-4f8f-a9d2-f11c8ff78ea7 tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-311bd127-36aa-4996-a952-2a695b03dca0 req-22709276-b7e7-4f8f-a9d2-f11c8ff78ea7 tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-311bd127-36aa-4996-a952-2a695b03dca0 req-22709276-b7e7-4f8f-a9d2-f11c8ff78ea7 tempest-AttachVolumeNegativeTest-1666839905 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14', 'name': 'volume-68c30be9-2289-4886-b80d-d71e1ada24d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01a4709a-e2f1-4c9a-a22f-1983c5196440', 'enforce_multipath': True} {{(pid=87016) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:28:32 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-311bd127-36aa-4996-a952-2a695b03dca0 req-22709276-b7e7-4f8f-a9d2-f11c8ff78ea7 tempest-AttachVolumeNegativeTest-1666839905 None] attachment_update completed successfully. Nov 03 07:28:32 devstack sudo[93506]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-599dca2a-f5ae-403e-88e0-89075926ba81 tempest-VolumesActionsTest-1848154357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.675s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:32 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-599dca2a-f5ae-403e-88e0-89075926ba81 tempest-VolumesActionsTest-1848154357 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:28:32 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-599dca2a-f5ae-403e-88e0-89075926ba81 tempest-VolumesActionsTest-1848154357 None] Deleted volume successfully. Nov 03 07:28:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-599dca2a-f5ae-403e-88e0-89075926ba81 tempest-VolumesActionsTest-1848154357 None] Lock "cinder-f40f41eb-9b37-44b9-9b17-c82ef58b5184-delete_volume" released by "delete_volume" :: held 3.283s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:28:37 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-762c6349-c4b1-4007-aa37-be43210bfd09 req-8534fb82-986a-419c-88d7-cb6ce893dafc tempest-AttachVolumeNegativeTest-1666839905 None] Terminate volume connection completed successfully. Nov 03 07:28:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-762c6349-c4b1-4007-aa37-be43210bfd09 req-8534fb82-986a-419c-88d7-cb6ce893dafc tempest-AttachVolumeNegativeTest-1666839905 None] Deleting attachment 01a4709a-e2f1-4c9a-a22f-1983c5196440. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:28:42 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=21,cinder:INSERT=1,cinder:UPDATE=22,cinder:DELETE=3 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:28:47 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:UPDATE=15,cinder:SELECT=31,cinder:INSERT=5 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:28:48 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:28:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Flow 'volume_create_manager' (44eb587e-2edb-46fc-8b69-d90e12d0fff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:28:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5779d8c8-d1b2-4658-9968-02eacc7d7ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5779d8c8-d1b2-4658-9968-02eacc7d7ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-96385479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f28400-a7f8-4ffc-b34e-43560f208a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b687467672544e19bdb1d9f67f07d02e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:28:48Z,use_quota=True,user_id='9617517aeb524741b90660632782f2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b2338e5-37ae-4c5a-9899-a15c8a01b798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b2338e5-37ae-4c5a-9899-a15c8a01b798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3bf8040-008b-4ece-8a23-9536e45d1d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3bf8040-008b-4ece-8a23-9536e45d1d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19f28400-a7f8-4ffc-b34e-43560f208a73', 'volume_name': 'volume-19f28400-a7f8-4ffc-b34e-43560f208a73', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37cffcbf-15fd-4906-b216-f322f457faa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37cffcbf-15fd-4906-b216-f322f457faa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc161044-d680-4c9e-8da2-531ffaeab26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:48 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Volume 19f28400-a7f8-4ffc-b34e-43560f208a73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19f28400-a7f8-4ffc-b34e-43560f208a73', 'volume_size': 1} Nov 03 07:28:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-96385479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f28400-a7f8-4ffc-b34e-43560f208a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b687467672544e19bdb1d9f67f07d02e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:28:48Z,use_quota=True,user_id='9617517aeb524741b90660632782f2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:28:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Creating volume 19f28400-a7f8-4ffc-b34e-43560f208a73 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:28:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:28:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:28:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:28:48 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:28:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-19f28400-a7f8-4ffc-b34e-43560f208a73 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:48 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-19f28400-a7f8-4ffc-b34e-43560f208a73 1073741824 Nov 03 07:28:48 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:28:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:28:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:28:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:49 devstack sudo[94173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:28:49 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:49 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.612s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:28:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:28:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 28 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:28:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:28:49 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-19f28400-a7f8-4ffc-b34e-43560f208a73 1073741824" returned: 0 in 1.069s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-19f28400-a7f8-4ffc-b34e-43560f208a73 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:50 devstack sudo[94213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-19f28400-a7f8-4ffc-b34e-43560f208a73 Nov 03 07:28:50 devstack sudo[94213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:50 devstack sudo[94213]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-19f28400-a7f8-4ffc-b34e-43560f208a73" returned: 0 in 0.400s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:28:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc161044-d680-4c9e-8da2-531ffaeab26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19f28400-a7f8-4ffc-b34e-43560f208a73', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c7624d-4e0f-4bd4-99fb-4dd19ce6b090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:50 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Volume volume-19f28400-a7f8-4ffc-b34e-43560f208a73 (19f28400-a7f8-4ffc-b34e-43560f208a73): created successfully Nov 03 07:28:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c7624d-4e0f-4bd4-99fb-4dd19ce6b090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Flow 'volume_create_manager' (44eb587e-2edb-46fc-8b69-d90e12d0fff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:28:50 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-889d967c-bc84-46bc-83e8-dd8b13765037 tempest-ServerRescueNegativeTestJSON-1024507062 None] Created volume successfully. Nov 03 07:28:56 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:28:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Flow 'volume_create_manager' (3aafb5cd-df9d-4768-8446-1608b79ea321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:28:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36125e20-e782-4bad-ba16-5d9f6666f58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36125e20-e782-4bad-ba16-5d9f6666f58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-399899711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc611d6-562c-4ed5-9fde-7b84dd904db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d811b5d40d7431791eb4c4963c1bbb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:28:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:28:56Z,use_quota=True,user_id='8f5c33db25a54809a44699916f251d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9922719-da3c-4b89-8104-c5b50f9f2570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9922719-da3c-4b89-8104-c5b50f9f2570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05868b6d-f392-4cf1-bf68-0e680f4e0903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05868b6d-f392-4cf1-bf68-0e680f4e0903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bc611d6-562c-4ed5-9fde-7b84dd904db5', 'volume_name': 'volume-1bc611d6-562c-4ed5-9fde-7b84dd904db5', 'volume_size': 2}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f61a82f-d09c-4215-9016-941b86253e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f61a82f-d09c-4215-9016-941b86253e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73c13d5-68a7-4ca1-902f-1a225d6b6456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:56 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Volume 1bc611d6-562c-4ed5-9fde-7b84dd904db5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bc611d6-562c-4ed5-9fde-7b84dd904db5', 'volume_size': 2} Nov 03 07:28:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-399899711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc611d6-562c-4ed5-9fde-7b84dd904db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d811b5d40d7431791eb4c4963c1bbb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:28:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:28:56Z,use_quota=True,user_id='8f5c33db25a54809a44699916f251d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:28:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Creating volume 1bc611d6-562c-4ed5-9fde-7b84dd904db5 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:28:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:28:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:28:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:28:56 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:28:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1bc611d6-562c-4ed5-9fde-7b84dd904db5 2147483648 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:56 devstack sudo[94253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1bc611d6-562c-4ed5-9fde-7b84dd904db5 2147483648 Nov 03 07:28:56 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:57 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1bc611d6-562c-4ed5-9fde-7b84dd904db5 2147483648" returned: 0 in 1.261s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1bc611d6-562c-4ed5-9fde-7b84dd904db5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:57 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1bc611d6-562c-4ed5-9fde-7b84dd904db5 Nov 03 07:28:57 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:58 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1bc611d6-562c-4ed5-9fde-7b84dd904db5" returned: 0 in 0.467s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:28:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73c13d5-68a7-4ca1-902f-1a225d6b6456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bc611d6-562c-4ed5-9fde-7b84dd904db5', 'volume_size': 2}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b434ecad-5d5a-4971-a315-0b7aff6d255e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:58 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Volume volume-1bc611d6-562c-4ed5-9fde-7b84dd904db5 (1bc611d6-562c-4ed5-9fde-7b84dd904db5): created successfully Nov 03 07:28:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b434ecad-5d5a-4971-a315-0b7aff6d255e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Flow 'volume_create_manager' (3aafb5cd-df9d-4768-8446-1608b79ea321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:28:58 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a83d7fba-fe63-412f-acb9-526f0b99f6e0 tempest-VolumesCloneNegativeTest-658696285 None] Created volume successfully. Nov 03 07:29:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cc74194c-19f2-4a74-8cc7-80d0cd0bdcd6 tempest-VolumesCloneNegativeTest-658696285 None] Acquiring lock "cinder-1bc611d6-562c-4ed5-9fde-7b84dd904db5-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cc74194c-19f2-4a74-8cc7-80d0cd0bdcd6 tempest-VolumesCloneNegativeTest-658696285 None] Lock "cinder-1bc611d6-562c-4ed5-9fde-7b84dd904db5-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cc74194c-19f2-4a74-8cc7-80d0cd0bdcd6 tempest-VolumesCloneNegativeTest-658696285 None] Acquiring lock "cinder-quobyte-1bc611d6-562c-4ed5-9fde-7b84dd904db5" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cc74194c-19f2-4a74-8cc7-80d0cd0bdcd6 tempest-VolumesCloneNegativeTest-658696285 None] Lock "cinder-quobyte-1bc611d6-562c-4ed5-9fde-7b84dd904db5" acquired by "delete_volume" :: waited 0.046s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:00 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e18e1d-42ce-4624-a952-cef2d492b78e]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cc74194c-19f2-4a74-8cc7-80d0cd0bdcd6 tempest-VolumesCloneNegativeTest-658696285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1bc611d6-562c-4ed5-9fde-7b84dd904db5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:00 devstack sudo[94291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1bc611d6-562c-4ed5-9fde-7b84dd904db5 Nov 03 07:29:00 devstack sudo[94291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:01 devstack sudo[94291]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cc74194c-19f2-4a74-8cc7-80d0cd0bdcd6 tempest-VolumesCloneNegativeTest-658696285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1bc611d6-562c-4ed5-9fde-7b84dd904db5" returned: 0 in 1.109s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cc74194c-19f2-4a74-8cc7-80d0cd0bdcd6 tempest-VolumesCloneNegativeTest-658696285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1bc611d6-562c-4ed5-9fde-7b84dd904db5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:01 devstack sudo[94319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1bc611d6-562c-4ed5-9fde-7b84dd904db5 Nov 03 07:29:01 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:02 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cc74194c-19f2-4a74-8cc7-80d0cd0bdcd6 tempest-VolumesCloneNegativeTest-658696285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1bc611d6-562c-4ed5-9fde-7b84dd904db5" returned: 0 in 0.509s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:02 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cc74194c-19f2-4a74-8cc7-80d0cd0bdcd6 tempest-VolumesCloneNegativeTest-658696285 None] Lock "cinder-quobyte-1bc611d6-562c-4ed5-9fde-7b84dd904db5" released by "delete_volume" :: held 1.804s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:02 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-cc74194c-19f2-4a74-8cc7-80d0cd0bdcd6 tempest-VolumesCloneNegativeTest-658696285 None] Created reservations ['d4646a9c-d1e1-4f7e-a37d-6183968c9c7d', 'ee454cbc-b5a0-4f3f-972c-a988b2d7ceec', '3b89ef36-7b45-4174-a95f-115e3db4d6f9', '08b85d9d-4422-4f0f-9379-859a337dc90b'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:29:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-cc74194c-19f2-4a74-8cc7-80d0cd0bdcd6 tempest-VolumesCloneNegativeTest-658696285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-cc74194c-19f2-4a74-8cc7-80d0cd0bdcd6 tempest-VolumesCloneNegativeTest-658696285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:02 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-cc74194c-19f2-4a74-8cc7-80d0cd0bdcd6 tempest-VolumesCloneNegativeTest-658696285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:29:02 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-cc74194c-19f2-4a74-8cc7-80d0cd0bdcd6 tempest-VolumesCloneNegativeTest-658696285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:29:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-cc74194c-19f2-4a74-8cc7-80d0cd0bdcd6 tempest-VolumesCloneNegativeTest-658696285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cc74194c-19f2-4a74-8cc7-80d0cd0bdcd6 tempest-VolumesCloneNegativeTest-658696285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:02 devstack sudo[94345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:29:02 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:03 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cc74194c-19f2-4a74-8cc7-80d0cd0bdcd6 tempest-VolumesCloneNegativeTest-658696285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.563s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:03 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-cc74194c-19f2-4a74-8cc7-80d0cd0bdcd6 tempest-VolumesCloneNegativeTest-658696285 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:29:03 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-cc74194c-19f2-4a74-8cc7-80d0cd0bdcd6 tempest-VolumesCloneNegativeTest-658696285 None] Deleted volume successfully. Nov 03 07:29:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cc74194c-19f2-4a74-8cc7-80d0cd0bdcd6 tempest-VolumesCloneNegativeTest-658696285 None] Lock "cinder-1bc611d6-562c-4ed5-9fde-7b84dd904db5-delete_volume" released by "delete_volume" :: held 3.143s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f29b8f86-3a85-43a5-9bfc-879b437771fb tempest-ServerRescueNegativeTestJSON-1024507062 None] Acquiring lock "cinder-19f28400-a7f8-4ffc-b34e-43560f208a73-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f29b8f86-3a85-43a5-9bfc-879b437771fb tempest-ServerRescueNegativeTestJSON-1024507062 None] Lock "cinder-19f28400-a7f8-4ffc-b34e-43560f208a73-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f29b8f86-3a85-43a5-9bfc-879b437771fb tempest-ServerRescueNegativeTestJSON-1024507062 None] Acquiring lock "cinder-quobyte-19f28400-a7f8-4ffc-b34e-43560f208a73" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f29b8f86-3a85-43a5-9bfc-879b437771fb tempest-ServerRescueNegativeTestJSON-1024507062 None] Lock "cinder-quobyte-19f28400-a7f8-4ffc-b34e-43560f208a73" acquired by "delete_volume" :: waited 0.044s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:05 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[4053be24-b7bf-4cbd-9276-9055a2395b05]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f29b8f86-3a85-43a5-9bfc-879b437771fb tempest-ServerRescueNegativeTestJSON-1024507062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-19f28400-a7f8-4ffc-b34e-43560f208a73 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:05 devstack sudo[94386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-19f28400-a7f8-4ffc-b34e-43560f208a73 Nov 03 07:29:05 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:06 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f29b8f86-3a85-43a5-9bfc-879b437771fb tempest-ServerRescueNegativeTestJSON-1024507062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-19f28400-a7f8-4ffc-b34e-43560f208a73" returned: 0 in 0.910s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f29b8f86-3a85-43a5-9bfc-879b437771fb tempest-ServerRescueNegativeTestJSON-1024507062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-19f28400-a7f8-4ffc-b34e-43560f208a73 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:06 devstack sudo[94406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-19f28400-a7f8-4ffc-b34e-43560f208a73 Nov 03 07:29:06 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:07 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f29b8f86-3a85-43a5-9bfc-879b437771fb tempest-ServerRescueNegativeTestJSON-1024507062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-19f28400-a7f8-4ffc-b34e-43560f208a73" returned: 0 in 0.655s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:07 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f29b8f86-3a85-43a5-9bfc-879b437771fb tempest-ServerRescueNegativeTestJSON-1024507062 None] Lock "cinder-quobyte-19f28400-a7f8-4ffc-b34e-43560f208a73" released by "delete_volume" :: held 1.653s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:07 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-f29b8f86-3a85-43a5-9bfc-879b437771fb tempest-ServerRescueNegativeTestJSON-1024507062 None] Created reservations ['3ccf9b51-7c34-4060-809a-cc071e6056bc', '2d149745-be76-4ee8-836b-e1343979cf7c', 'ee90a5f1-d72a-4430-b5d4-ff8a74054217', '7d688bfa-04b3-459f-ae55-8ca0da78910a'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:29:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f29b8f86-3a85-43a5-9bfc-879b437771fb tempest-ServerRescueNegativeTestJSON-1024507062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f29b8f86-3a85-43a5-9bfc-879b437771fb tempest-ServerRescueNegativeTestJSON-1024507062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:07 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f29b8f86-3a85-43a5-9bfc-879b437771fb tempest-ServerRescueNegativeTestJSON-1024507062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:29:07 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f29b8f86-3a85-43a5-9bfc-879b437771fb tempest-ServerRescueNegativeTestJSON-1024507062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:29:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f29b8f86-3a85-43a5-9bfc-879b437771fb tempest-ServerRescueNegativeTestJSON-1024507062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f29b8f86-3a85-43a5-9bfc-879b437771fb tempest-ServerRescueNegativeTestJSON-1024507062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:07 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:29:07 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:08 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f29b8f86-3a85-43a5-9bfc-879b437771fb tempest-ServerRescueNegativeTestJSON-1024507062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.611s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:08 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-f29b8f86-3a85-43a5-9bfc-879b437771fb tempest-ServerRescueNegativeTestJSON-1024507062 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:29:08 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-f29b8f86-3a85-43a5-9bfc-879b437771fb tempest-ServerRescueNegativeTestJSON-1024507062 None] Deleted volume successfully. Nov 03 07:29:08 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f29b8f86-3a85-43a5-9bfc-879b437771fb tempest-ServerRescueNegativeTestJSON-1024507062 None] Lock "cinder-19f28400-a7f8-4ffc-b34e-43560f208a73-delete_volume" released by "delete_volume" :: held 2.762s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:13 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:29:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Flow 'volume_create_manager' (ecf223e7-87c2-4d05-be88-ce31124e9231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:29:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9338ea30-cee0-434f-9278-8777ddafdf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9338ea30-cee0-434f-9278-8777ddafdf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-107536891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=746bb9a3-32cc-4fc8-9f1d-2969d361c5fc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13c1ca53184f48b2ade6da7c0d01bba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:29:14Z,use_quota=True,user_id='159aad2c4bca421fa588a10ab9998048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81591de5-c60f-4e37-a04b-38fa7ab35e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81591de5-c60f-4e37-a04b-38fa7ab35e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91db1268-df1f-4cf3-8b99-9a12afa4a990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91db1268-df1f-4cf3-8b99-9a12afa4a990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '746bb9a3-32cc-4fc8-9f1d-2969d361c5fc', 'volume_name': 'volume-746bb9a3-32cc-4fc8-9f1d-2969d361c5fc', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b78fff0-674a-4650-9850-963ce59454f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b78fff0-674a-4650-9850-963ce59454f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f0752c-f364-4312-b5d5-883bdac353a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:14 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Volume 746bb9a3-32cc-4fc8-9f1d-2969d361c5fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-746bb9a3-32cc-4fc8-9f1d-2969d361c5fc', 'volume_size': 1} Nov 03 07:29:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-107536891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=746bb9a3-32cc-4fc8-9f1d-2969d361c5fc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13c1ca53184f48b2ade6da7c0d01bba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:29:14Z,use_quota=True,user_id='159aad2c4bca421fa588a10ab9998048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:29:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Creating volume 746bb9a3-32cc-4fc8-9f1d-2969d361c5fc {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:29:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:29:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:29:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:29:14 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:29:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-746bb9a3-32cc-4fc8-9f1d-2969d361c5fc 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:14 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-746bb9a3-32cc-4fc8-9f1d-2969d361c5fc 1073741824 Nov 03 07:29:14 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:15 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-746bb9a3-32cc-4fc8-9f1d-2969d361c5fc 1073741824" returned: 0 in 1.259s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-746bb9a3-32cc-4fc8-9f1d-2969d361c5fc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:15 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-746bb9a3-32cc-4fc8-9f1d-2969d361c5fc Nov 03 07:29:15 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:16 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-746bb9a3-32cc-4fc8-9f1d-2969d361c5fc" returned: 0 in 0.561s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] <== create_volume: return (1937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:29:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.945s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:16 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f0752c-f364-4312-b5d5-883bdac353a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-746bb9a3-32cc-4fc8-9f1d-2969d361c5fc', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:16 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (903172db-13d0-4c5e-9602-0de1b4be0d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:16 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Volume volume-746bb9a3-32cc-4fc8-9f1d-2969d361c5fc (746bb9a3-32cc-4fc8-9f1d-2969d361c5fc): created successfully Nov 03 07:29:16 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (903172db-13d0-4c5e-9602-0de1b4be0d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:16 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Flow 'volume_create_manager' (ecf223e7-87c2-4d05-be88-ce31124e9231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:29:16 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-197616c5-1e37-4e76-9d26-ad3eec339f4d tempest-VolumesGetTest-1309011963 None] Created volume successfully. Nov 03 07:29:18 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:29:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Flow 'volume_create_manager' (777f18d2-d5ea-4d2a-a63b-c9b954d49065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:29:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6f38101-9854-4fe3-938d-26fefdd69c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6f38101-9854-4fe3-938d-26fefdd69c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:29:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-531253730',display_name='tempest-VolumesGetTest-Volume-90856034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e8ea29b-c490-4763-9ceb-4b415a1c6c36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c1ca53184f48b2ade6da7c0d01bba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:29:18Z,use_quota=True,user_id='159aad2c4bca421fa588a10ab9998048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596f6c24-cfe1-47db-b31f-865a15f23fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596f6c24-cfe1-47db-b31f-865a15f23fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7754c074-2932-483b-8e0b-b255f0d2628f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7754c074-2932-483b-8e0b-b255f0d2628f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e8ea29b-c490-4763-9ceb-4b415a1c6c36', 'volume_name': 'volume-0e8ea29b-c490-4763-9ceb-4b415a1c6c36', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533136e1-0166-4886-94de-fe582341f5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533136e1-0166-4886-94de-fe582341f5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278fce4d-98bb-47db-9026-96ba36416cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:18 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Volume 0e8ea29b-c490-4763-9ceb-4b415a1c6c36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e8ea29b-c490-4763-9ceb-4b415a1c6c36', 'volume_size': 1} Nov 03 07:29:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:29:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-531253730',display_name='tempest-VolumesGetTest-Volume-90856034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e8ea29b-c490-4763-9ceb-4b415a1c6c36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c1ca53184f48b2ade6da7c0d01bba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:29:18Z,use_quota=True,user_id='159aad2c4bca421fa588a10ab9998048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:29:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Creating volume 0e8ea29b-c490-4763-9ceb-4b415a1c6c36 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:29:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:29:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:29:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:29:18 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:29:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0e8ea29b-c490-4763-9ceb-4b415a1c6c36 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:18 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0e8ea29b-c490-4763-9ceb-4b415a1c6c36 1073741824 Nov 03 07:29:18 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:19 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0e8ea29b-c490-4763-9ceb-4b415a1c6c36 1073741824" returned: 0 in 0.592s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0e8ea29b-c490-4763-9ceb-4b415a1c6c36 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:19 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0e8ea29b-c490-4763-9ceb-4b415a1c6c36 Nov 03 07:29:19 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:19 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0e8ea29b-c490-4763-9ceb-4b415a1c6c36" returned: 0 in 0.262s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:29:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278fce4d-98bb-47db-9026-96ba36416cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e8ea29b-c490-4763-9ceb-4b415a1c6c36', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed330bb0-7edb-4b56-852c-7e01f42e7d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:19 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Volume volume-0e8ea29b-c490-4763-9ceb-4b415a1c6c36 (0e8ea29b-c490-4763-9ceb-4b415a1c6c36): created successfully Nov 03 07:29:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed330bb0-7edb-4b56-852c-7e01f42e7d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Flow 'volume_create_manager' (777f18d2-d5ea-4d2a-a63b-c9b954d49065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:29:19 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ca634faf-c31e-4c0d-bb8d-96a091dda57a tempest-VolumesGetTest-1309011963 None] Created volume successfully. Nov 03 07:29:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c2758df0-f621-4aea-a313-a857e0988bbf tempest-VolumesGetTest-1309011963 None] Acquiring lock "cinder-0e8ea29b-c490-4763-9ceb-4b415a1c6c36-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c2758df0-f621-4aea-a313-a857e0988bbf tempest-VolumesGetTest-1309011963 None] Lock "cinder-0e8ea29b-c490-4763-9ceb-4b415a1c6c36-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c2758df0-f621-4aea-a313-a857e0988bbf tempest-VolumesGetTest-1309011963 None] Acquiring lock "cinder-quobyte-0e8ea29b-c490-4763-9ceb-4b415a1c6c36" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c2758df0-f621-4aea-a313-a857e0988bbf tempest-VolumesGetTest-1309011963 None] Lock "cinder-quobyte-0e8ea29b-c490-4763-9ceb-4b415a1c6c36" acquired by "delete_volume" :: waited 0.036s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:20 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[82473d7f-6ee5-4504-8ac0-e08abc9ee306]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c2758df0-f621-4aea-a313-a857e0988bbf tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0e8ea29b-c490-4763-9ceb-4b415a1c6c36 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:21 devstack sudo[94600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0e8ea29b-c490-4763-9ceb-4b415a1c6c36 Nov 03 07:29:21 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:21 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c2758df0-f621-4aea-a313-a857e0988bbf tempest-VolumesGetTest-1309011963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0e8ea29b-c490-4763-9ceb-4b415a1c6c36" returned: 0 in 0.497s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c2758df0-f621-4aea-a313-a857e0988bbf tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0e8ea29b-c490-4763-9ceb-4b415a1c6c36 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:21 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0e8ea29b-c490-4763-9ceb-4b415a1c6c36 Nov 03 07:29:21 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:21 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c2758df0-f621-4aea-a313-a857e0988bbf tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0e8ea29b-c490-4763-9ceb-4b415a1c6c36" returned: 0 in 0.287s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:21 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c2758df0-f621-4aea-a313-a857e0988bbf tempest-VolumesGetTest-1309011963 None] Lock "cinder-quobyte-0e8ea29b-c490-4763-9ceb-4b415a1c6c36" released by "delete_volume" :: held 0.836s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:21 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-c2758df0-f621-4aea-a313-a857e0988bbf tempest-VolumesGetTest-1309011963 None] Created reservations ['5acb2d23-8d55-43c0-affb-22dbf9c217e5', '24f0dcf8-6d38-4d4c-911b-88d10b105302', '6d004bb3-21df-4acf-83c3-0e3459e7376b', '53bd2ae2-49a2-4e57-bb99-4bcfdbc90add'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:29:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c2758df0-f621-4aea-a313-a857e0988bbf tempest-VolumesGetTest-1309011963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c2758df0-f621-4aea-a313-a857e0988bbf tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-c2758df0-f621-4aea-a313-a857e0988bbf tempest-VolumesGetTest-1309011963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:29:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-c2758df0-f621-4aea-a313-a857e0988bbf tempest-VolumesGetTest-1309011963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:29:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c2758df0-f621-4aea-a313-a857e0988bbf tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c2758df0-f621-4aea-a313-a857e0988bbf tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:21 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:29:21 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:22 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4f5814cc-bdc0-49a7-997e-03ac6b4f7064 tempest-VolumesGetTest-1309011963 None] Acquiring lock "cinder-746bb9a3-32cc-4fc8-9f1d-2969d361c5fc-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:22 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4f5814cc-bdc0-49a7-997e-03ac6b4f7064 tempest-VolumesGetTest-1309011963 None] Lock "cinder-746bb9a3-32cc-4fc8-9f1d-2969d361c5fc-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:22 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4f5814cc-bdc0-49a7-997e-03ac6b4f7064 tempest-VolumesGetTest-1309011963 None] Acquiring lock "cinder-quobyte-746bb9a3-32cc-4fc8-9f1d-2969d361c5fc" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:22 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4f5814cc-bdc0-49a7-997e-03ac6b4f7064 tempest-VolumesGetTest-1309011963 None] Lock "cinder-quobyte-746bb9a3-32cc-4fc8-9f1d-2969d361c5fc" acquired by "delete_volume" :: waited 0.036s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:22 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc681db-110e-4fa3-979c-10c9a863a3fe]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4f5814cc-bdc0-49a7-997e-03ac6b4f7064 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-746bb9a3-32cc-4fc8-9f1d-2969d361c5fc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:22 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c2758df0-f621-4aea-a313-a857e0988bbf tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.519s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:22 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-c2758df0-f621-4aea-a313-a857e0988bbf tempest-VolumesGetTest-1309011963 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:29:22 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-c2758df0-f621-4aea-a313-a857e0988bbf tempest-VolumesGetTest-1309011963 None] Deleted volume successfully. Nov 03 07:29:22 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c2758df0-f621-4aea-a313-a857e0988bbf tempest-VolumesGetTest-1309011963 None] Lock "cinder-0e8ea29b-c490-4763-9ceb-4b415a1c6c36-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:22 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-746bb9a3-32cc-4fc8-9f1d-2969d361c5fc Nov 03 07:29:22 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:22 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4f5814cc-bdc0-49a7-997e-03ac6b4f7064 tempest-VolumesGetTest-1309011963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-746bb9a3-32cc-4fc8-9f1d-2969d361c5fc" returned: 0 in 0.413s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4f5814cc-bdc0-49a7-997e-03ac6b4f7064 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-746bb9a3-32cc-4fc8-9f1d-2969d361c5fc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:22 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-746bb9a3-32cc-4fc8-9f1d-2969d361c5fc Nov 03 07:29:22 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:23 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4f5814cc-bdc0-49a7-997e-03ac6b4f7064 tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-746bb9a3-32cc-4fc8-9f1d-2969d361c5fc" returned: 0 in 0.300s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:23 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4f5814cc-bdc0-49a7-997e-03ac6b4f7064 tempest-VolumesGetTest-1309011963 None] Lock "cinder-quobyte-746bb9a3-32cc-4fc8-9f1d-2969d361c5fc" released by "delete_volume" :: held 0.787s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:23 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-4f5814cc-bdc0-49a7-997e-03ac6b4f7064 tempest-VolumesGetTest-1309011963 None] Created reservations ['edb6e883-1ae6-46cc-adb4-dce89d4d1275', 'c9fb3fc3-05d7-4770-806a-00dc273d5a43', '960c793e-d4ab-4c03-bf6f-7c270654a86f', 'f2e279f0-cf58-455c-885b-29604e030fe9'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:29:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4f5814cc-bdc0-49a7-997e-03ac6b4f7064 tempest-VolumesGetTest-1309011963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4f5814cc-bdc0-49a7-997e-03ac6b4f7064 tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4f5814cc-bdc0-49a7-997e-03ac6b4f7064 tempest-VolumesGetTest-1309011963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:29:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4f5814cc-bdc0-49a7-997e-03ac6b4f7064 tempest-VolumesGetTest-1309011963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:29:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4f5814cc-bdc0-49a7-997e-03ac6b4f7064 tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4f5814cc-bdc0-49a7-997e-03ac6b4f7064 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:23 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:29:23 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:23 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4f5814cc-bdc0-49a7-997e-03ac6b4f7064 tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.380s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:23 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-4f5814cc-bdc0-49a7-997e-03ac6b4f7064 tempest-VolumesGetTest-1309011963 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:29:23 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-4f5814cc-bdc0-49a7-997e-03ac6b4f7064 tempest-VolumesGetTest-1309011963 None] Deleted volume successfully. Nov 03 07:29:23 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4f5814cc-bdc0-49a7-997e-03ac6b4f7064 tempest-VolumesGetTest-1309011963 None] Lock "cinder-746bb9a3-32cc-4fc8-9f1d-2969d361c5fc-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:24 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:29:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Flow 'volume_create_manager' (03265a80-13ae-49c9-93ca-3a44e4ebd347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:29:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ce4aab-952f-43e4-81dd-064c77e27f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ce4aab-952f-43e4-81dd-064c77e27f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2044197482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4feb1f36-e6e8-48be-b5ae-94a32a271332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c1ca53184f48b2ade6da7c0d01bba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:29:24Z,use_quota=True,user_id='159aad2c4bca421fa588a10ab9998048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0775e2eb-b160-4061-a11e-7e64b7e5115b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0775e2eb-b160-4061-a11e-7e64b7e5115b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50b4c887-0787-4ab4-8cba-5020d28bc08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50b4c887-0787-4ab4-8cba-5020d28bc08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4feb1f36-e6e8-48be-b5ae-94a32a271332', 'volume_name': 'volume-4feb1f36-e6e8-48be-b5ae-94a32a271332', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ef1e76-67fa-4d1f-a298-4cc953e026c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ef1e76-67fa-4d1f-a298-4cc953e026c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aabec31d-1536-45e0-b577-60e94f43819a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:24 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Volume 4feb1f36-e6e8-48be-b5ae-94a32a271332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4feb1f36-e6e8-48be-b5ae-94a32a271332', 'volume_size': 1} Nov 03 07:29:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:24 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2044197482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4feb1f36-e6e8-48be-b5ae-94a32a271332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c1ca53184f48b2ade6da7c0d01bba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:29:24Z,use_quota=True,user_id='159aad2c4bca421fa588a10ab9998048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:29:24 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Creating volume 4feb1f36-e6e8-48be-b5ae-94a32a271332 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:29:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:24 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:29:24 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:29:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:24 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:29:24 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:29:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:24 devstack sudo[94644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332 1073741824 Nov 03 07:29:24 devstack sudo[94644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:25 devstack sudo[94644]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332 1073741824" returned: 0 in 0.699s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:25 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332 Nov 03 07:29:25 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:25 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-b3ea78ec-6e1b-4077-ab23-1f9414ef4761 req-e17f871d-bd1b-4731-a90b-cca95a4ae0ba tempest-AttachVolumeTestJSON-654495122 None] Terminate volume connection completed successfully. Nov 03 07:29:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-b3ea78ec-6e1b-4077-ab23-1f9414ef4761 req-e17f871d-bd1b-4731-a90b-cca95a4ae0ba tempest-AttachVolumeTestJSON-654495122 None] Deleting attachment d021afa0-88e5-45ea-bea1-a8e52431a835. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:29:25 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332" returned: 0 in 0.361s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:29:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aabec31d-1536-45e0-b577-60e94f43819a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4feb1f36-e6e8-48be-b5ae-94a32a271332', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea0760b-cbb1-494c-b556-ea3b6213c155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:25 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Volume volume-4feb1f36-e6e8-48be-b5ae-94a32a271332 (4feb1f36-e6e8-48be-b5ae-94a32a271332): created successfully Nov 03 07:29:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea0760b-cbb1-494c-b556-ea3b6213c155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Flow 'volume_create_manager' (03265a80-13ae-49c9-93ca-3a44e4ebd347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:29:25 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-3d224151-2c0c-4fb8-ad36-c899d059cf4c tempest-VolumesGetTest-1309011963 None] Created volume successfully. Nov 03 07:29:26 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:29:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Flow 'volume_create_manager' (5e86681f-661d-4f60-a012-88e67f983620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:29:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815ec8d6-c1f5-46ee-aa87-4b452598f88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815ec8d6-c1f5-46ee-aa87-4b452598f88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1990723398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ff5653-74d0-42a6-a66a-c84864bab18f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13c1ca53184f48b2ade6da7c0d01bba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4feb1f36-e6e8-48be-b5ae-94a32a271332,status='creating',terminated_at=None,updated_at=2026-11-03T06:29:27Z,use_quota=True,user_id='159aad2c4bca421fa588a10ab9998048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f736344c-8efc-4f64-a7bb-75cc2b0effd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f736344c-8efc-4f64-a7bb-75cc2b0effd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1271d5c8-a588-4717-86b8-8ea1d62116a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1271d5c8-a588-4717-86b8-8ea1d62116a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '20ff5653-74d0-42a6-a66a-c84864bab18f', 'volume_name': 'volume-20ff5653-74d0-42a6-a66a-c84864bab18f', 'volume_size': 1, 'source_volid': '4feb1f36-e6e8-48be-b5ae-94a32a271332', 'source_volstatus': 'available'}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6431e788-465c-4226-b599-7b32edc345a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6431e788-465c-4226-b599-7b32edc345a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c98b97-479f-4eb0-95be-a3fc47904c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:26 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Volume 20ff5653-74d0-42a6-a66a-c84864bab18f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-20ff5653-74d0-42a6-a66a-c84864bab18f', 'volume_size': 1, 'source_volid': '4feb1f36-e6e8-48be-b5ae-94a32a271332', 'source_volstatus': 'available'} Nov 03 07:29:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:26 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Cloning volume 4feb1f36-e6e8-48be-b5ae-94a32a271332 to volume 20ff5653-74d0-42a6-a66a-c84864bab18f Nov 03 07:29:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Creating offline snapshot 2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32 of volume 4feb1f36-e6e8-48be-b5ae-94a32a271332 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:29:27 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa436c80-14d5-4b64-8aef-41343fb46ff3]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:27 devstack sudo[94663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332 Nov 03 07:29:27 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:27 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332" returned: 0 in 0.425s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:27 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32 1G Nov 03 07:29:27 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:28 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32 1G" returned: 0 in 0.607s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4feb1f36-e6e8-48be-b5ae-94a32a271332 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:28 devstack sudo[94677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4feb1f36-e6e8-48be-b5ae-94a32a271332 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32 Nov 03 07:29:28 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:28 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4feb1f36-e6e8-48be-b5ae-94a32a271332 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32" returned: 0 in 0.437s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:28 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32 is being set with open permissions: ugo+rw Nov 03 07:29:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:28 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32 Nov 03 07:29:28 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:28 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32" returned: 0 in 0.305s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:28 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.info Nov 03 07:29:28 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:29 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.info" returned: 0 in 0.426s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:29 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.info is being set with open permissions: ugo+rw Nov 03 07:29:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:29 devstack sudo[94701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.info Nov 03 07:29:29 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:29 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.info" returned: 0 in 0.368s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Acquiring lock "cinder-quobyte-20ff5653-74d0-42a6-a66a-c84864bab18f" by "_copy_volume_from_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Lock "cinder-quobyte-20ff5653-74d0-42a6-a66a-c84864bab18f" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] snapshot: 2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32, volume: 20ff5653-74d0-42a6-a66a-c84864bab18f, {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:29:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:29:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:29:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:29 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[630f3d5c-84c1-4fb5-ba32-d8ec69a46e67]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:30 devstack sudo[94716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32 Nov 03 07:29:30 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:30 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32" returned: 0 in 0.699s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4feb1f36-e6e8-48be-b5ae-94a32a271332(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:29:30 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e20c297-0d0e-4af9-a615-8f1e2b97ee9c]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:30 devstack sudo[94746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332 Nov 03 07:29:30 devstack sudo[94746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:31 devstack sudo[94746]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332" returned: 0 in 0.921s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:31 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332 {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:29:31 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Creating direct copy from snapshot {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:29:31 devstack cinder-volume[87016]: DEBUG cinder.utils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Path /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-20ff5653-74d0-42a6-a66a-c84864bab18f not found in is_blk_device check {{(pid=87016) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 07:29:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-20ff5653-74d0-42a6-a66a-c84864bab18f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:31 devstack sudo[94794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-20ff5653-74d0-42a6-a66a-c84864bab18f Nov 03 07:29:31 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:36 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:29:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Flow 'volume_create_manager' (cb22bbca-d61a-4369-a178-fea6a9273ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:29:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3f4089c-af42-407d-b3d4-3f35de1974fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3f4089c-af42-407d-b3d4-3f35de1974fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1046085940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f3d896-8489-4523-96aa-3a9b0f7291e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485c1b2e7e034556a572fe1555b9437f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:29:37Z,use_quota=True,user_id='3915baa0841c4d00bbf3ac646ec2c32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b594c0f-a2ce-4ae6-9ce2-2d7328548cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b594c0f-a2ce-4ae6-9ce2-2d7328548cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e12e0b97-5719-4164-86fe-746aba4444a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e12e0b97-5719-4164-86fe-746aba4444a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53f3d896-8489-4523-96aa-3a9b0f7291e9', 'volume_name': 'volume-53f3d896-8489-4523-96aa-3a9b0f7291e9', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876952e3-6863-4ee2-a9ad-c7edbc8819f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876952e3-6863-4ee2-a9ad-c7edbc8819f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a723509c-5d60-41ae-98dd-d210cf06a22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:37 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Volume 53f3d896-8489-4523-96aa-3a9b0f7291e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53f3d896-8489-4523-96aa-3a9b0f7291e9', 'volume_size': 1} Nov 03 07:29:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:41 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-20ff5653-74d0-42a6-a66a-c84864bab18f" returned: 0 in 10.164s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:41 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Image conversion details: src /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332, size 1024.00 MB, duration 10.16 sec, destination /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-20ff5653-74d0-42a6-a66a-c84864bab18f {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:29:41 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Converted 1024.00 MB image at 100.74 MB/s Nov 03 07:29:41 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-20ff5653-74d0-42a6-a66a-c84864bab18f is being set with open permissions: ugo+rw Nov 03 07:29:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-20ff5653-74d0-42a6-a66a-c84864bab18f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:41 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-20ff5653-74d0-42a6-a66a-c84864bab18f Nov 03 07:29:41 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:42 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-20ff5653-74d0-42a6-a66a-c84864bab18f" returned: 0 in 0.381s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:42 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Lock "cinder-quobyte-20ff5653-74d0-42a6-a66a-c84864bab18f" released by "_copy_volume_from_snapshot" :: held 12.323s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:42 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Acquiring lock "cinder-quobyte-2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:42 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Lock "cinder-quobyte-2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Deleting offline snapshot 2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32 of volume 4feb1f36-e6e8-48be-b5ae-94a32a271332 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:29:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] snapshot_file for this snap is: volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:29:42 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[511e5ddc-f2cb-4cc4-9f67-aefec949b16f]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:42 devstack sudo[94822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32 Nov 03 07:29:42 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:42 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32" returned: 0 in 0.682s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4feb1f36-e6e8-48be-b5ae-94a32a271332(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:29:42 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[8688ba8a-42ad-4b8a-b4a1-3034146dd1f1]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:43 devstack sudo[94833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332 Nov 03 07:29:43 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:43 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332" returned: 0 in 0.870s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:43 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32 Nov 03 07:29:43 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:44 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32" returned: 0 in 0.493s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:44 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32 Nov 03 07:29:44 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:44 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332.2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32" returned: 0 in 0.291s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Lock "cinder-quobyte-2a8fbe82-d3ea-4f8d-a885-a44f19bc4f32" released by "_delete_snapshot" :: held 2.498s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:44 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=33,cinder:INSERT=10,cinder:UPDATE=51,cinder:DELETE=6 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:29:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.691s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.595s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1046085940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f3d896-8489-4523-96aa-3a9b0f7291e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485c1b2e7e034556a572fe1555b9437f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:29:37Z,use_quota=True,user_id='3915baa0841c4d00bbf3ac646ec2c32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:29:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Creating volume 53f3d896-8489-4523-96aa-3a9b0f7291e9 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:29:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:29:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:29:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:29:44 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:29:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-53f3d896-8489-4523-96aa-3a9b0f7291e9 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:44 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-53f3d896-8489-4523-96aa-3a9b0f7291e9 1073741824 Nov 03 07:29:44 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c98b97-479f-4eb0-95be-a3fc47904c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20ff5653-74d0-42a6-a66a-c84864bab18f', 'volume_size': 1, 'source_volid': '4feb1f36-e6e8-48be-b5ae-94a32a271332', 'source_volstatus': 'available'}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8658e91b-9eb5-4340-8b52-b7de00c1f345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:44 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Volume volume-20ff5653-74d0-42a6-a66a-c84864bab18f (20ff5653-74d0-42a6-a66a-c84864bab18f): created successfully Nov 03 07:29:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8658e91b-9eb5-4340-8b52-b7de00c1f345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Flow 'volume_create_manager' (5e86681f-661d-4f60-a012-88e67f983620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:29:44 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-5e2857e9-31e1-4f02-ab64-12aa1e6b76c9 tempest-VolumesGetTest-1309011963 None] Created volume successfully. Nov 03 07:29:45 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-53f3d896-8489-4523-96aa-3a9b0f7291e9 1073741824" returned: 0 in 0.615s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-53f3d896-8489-4523-96aa-3a9b0f7291e9 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:45 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-53f3d896-8489-4523-96aa-3a9b0f7291e9 Nov 03 07:29:45 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:45 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-53f3d896-8489-4523-96aa-3a9b0f7291e9" returned: 0 in 0.482s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:45 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:29:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a723509c-5d60-41ae-98dd-d210cf06a22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53f3d896-8489-4523-96aa-3a9b0f7291e9', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2d56bf-84d5-4756-bf17-45070e9cb5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:45 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Volume volume-53f3d896-8489-4523-96aa-3a9b0f7291e9 (53f3d896-8489-4523-96aa-3a9b0f7291e9): created successfully Nov 03 07:29:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2d56bf-84d5-4756-bf17-45070e9cb5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Flow 'volume_create_manager' (cb22bbca-d61a-4369-a178-fea6a9273ac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:29:45 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-d75dac16-2392-455e-842b-c89c2938ac0f tempest-AttachVolumeNegativeTest-1666839905 None] Created volume successfully. Nov 03 07:29:46 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:29:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Flow 'volume_create_manager' (18e2b727-b33d-480a-8496-3402d8144304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:29:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5044d32d-d82c-4870-8f7c-9aef2e0304dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5044d32d-d82c-4870-8f7c-9aef2e0304dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:29:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1211753155',display_name='tempest-VolumesGetTest-Volume-2036153143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c1ca53184f48b2ade6da7c0d01bba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:29:47Z,use_quota=True,user_id='159aad2c4bca421fa588a10ab9998048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3004185a-739c-452b-8799-32632af8189d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3004185a-739c-452b-8799-32632af8189d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2c0af2-7712-4e30-b67a-4176bf5be43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2c0af2-7712-4e30-b67a-4176bf5be43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5', 'volume_name': 'volume-ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe8e78d1-b3d7-4cd5-aad5-31211aa38800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe8e78d1-b3d7-4cd5-aad5-31211aa38800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b360fd6-8862-4d62-96fa-74e503367826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:46 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Volume ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5', 'volume_size': 1} Nov 03 07:29:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:29:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1211753155',display_name='tempest-VolumesGetTest-Volume-2036153143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c1ca53184f48b2ade6da7c0d01bba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:29:47Z,use_quota=True,user_id='159aad2c4bca421fa588a10ab9998048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:29:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Creating volume ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:29:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:29:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:29:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:29:46 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:29:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:46 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5 1073741824 Nov 03 07:29:46 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:47 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5 1073741824" returned: 0 in 0.660s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:47 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=43,cinder:UPDATE=56,cinder:INSERT=14,cinder:DELETE=5 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:29:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:47 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5 Nov 03 07:29:47 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:47 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5" returned: 0 in 0.326s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:29:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b360fd6-8862-4d62-96fa-74e503367826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec7c762a-0735-4a76-a49a-a9da144c63b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:47 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Volume volume-ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5 (ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5): created successfully Nov 03 07:29:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec7c762a-0735-4a76-a49a-a9da144c63b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Flow 'volume_create_manager' (18e2b727-b33d-480a-8496-3402d8144304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:29:47 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-8427a0b2-395e-4a30-9506-acad5776db72 tempest-VolumesGetTest-1309011963 None] Created volume successfully. Nov 03 07:29:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-d134e0d1-7b7e-4105-9ba3-a5d450a0c6c2 req-8536e2ba-b4e4-4069-8587-0550089a64cf tempest-AttachVolumeNegativeTest-1666839905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-d134e0d1-7b7e-4105-9ba3-a5d450a0c6c2 req-8536e2ba-b4e4-4069-8587-0550089a64cf tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-d134e0d1-7b7e-4105-9ba3-a5d450a0c6c2 req-8536e2ba-b4e4-4069-8587-0550089a64cf tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-d134e0d1-7b7e-4105-9ba3-a5d450a0c6c2 req-8536e2ba-b4e4-4069-8587-0550089a64cf tempest-AttachVolumeNegativeTest-1666839905 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14', 'name': 'volume-53f3d896-8489-4523-96aa-3a9b0f7291e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ddb63fa-77d7-4de8-a7d4-0e0024951fe4', 'enforce_multipath': True} {{(pid=87016) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:29:48 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-d134e0d1-7b7e-4105-9ba3-a5d450a0c6c2 req-8536e2ba-b4e4-4069-8587-0550089a64cf tempest-AttachVolumeNegativeTest-1666839905 None] attachment_update completed successfully. Nov 03 07:29:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-098b1b7b-2c19-4353-9cdc-c772fc41675f tempest-VolumesGetTest-1309011963 None] Acquiring lock "cinder-ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-098b1b7b-2c19-4353-9cdc-c772fc41675f tempest-VolumesGetTest-1309011963 None] Lock "cinder-ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:49 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-098b1b7b-2c19-4353-9cdc-c772fc41675f tempest-VolumesGetTest-1309011963 None] Acquiring lock "cinder-quobyte-ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:49 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-098b1b7b-2c19-4353-9cdc-c772fc41675f tempest-VolumesGetTest-1309011963 None] Lock "cinder-quobyte-ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5" acquired by "delete_volume" :: waited 0.034s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:29:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:29:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:29:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:49 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c97b12-3e23-4d24-bddf-b127cc85997d]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-098b1b7b-2c19-4353-9cdc-c772fc41675f tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:49 devstack sudo[95299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:29:49 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:49 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5 Nov 03 07:29:49 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:49 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.341s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:29:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:29:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 28 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:29:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:29:49 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-098b1b7b-2c19-4353-9cdc-c772fc41675f tempest-VolumesGetTest-1309011963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5" returned: 0 in 0.483s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-098b1b7b-2c19-4353-9cdc-c772fc41675f tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:49 devstack sudo[95308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5 Nov 03 07:29:49 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:49 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-098b1b7b-2c19-4353-9cdc-c772fc41675f tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5" returned: 0 in 0.340s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:49 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-098b1b7b-2c19-4353-9cdc-c772fc41675f tempest-VolumesGetTest-1309011963 None] Lock "cinder-quobyte-ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5" released by "delete_volume" :: held 0.908s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:50 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-098b1b7b-2c19-4353-9cdc-c772fc41675f tempest-VolumesGetTest-1309011963 None] Created reservations ['c50e43b1-32df-466e-a803-fb3ea3632041', 'f11a9aa8-ec98-4a30-915b-7ee801644074', 'a99cff2b-de12-4e77-a6f4-c0e805a0a5bd', 'bf5b6198-c6e6-4b43-a895-1398c881301b'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:29:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-098b1b7b-2c19-4353-9cdc-c772fc41675f tempest-VolumesGetTest-1309011963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-098b1b7b-2c19-4353-9cdc-c772fc41675f tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-098b1b7b-2c19-4353-9cdc-c772fc41675f tempest-VolumesGetTest-1309011963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:29:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-098b1b7b-2c19-4353-9cdc-c772fc41675f tempest-VolumesGetTest-1309011963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:29:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-098b1b7b-2c19-4353-9cdc-c772fc41675f tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-098b1b7b-2c19-4353-9cdc-c772fc41675f tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:50 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:29:50 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-de969c89-fbc2-4da4-9382-08c31d081576 tempest-VolumesGetTest-1309011963 None] Acquiring lock "cinder-20ff5653-74d0-42a6-a66a-c84864bab18f-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-de969c89-fbc2-4da4-9382-08c31d081576 tempest-VolumesGetTest-1309011963 None] Lock "cinder-20ff5653-74d0-42a6-a66a-c84864bab18f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-de969c89-fbc2-4da4-9382-08c31d081576 tempest-VolumesGetTest-1309011963 None] Acquiring lock "cinder-quobyte-20ff5653-74d0-42a6-a66a-c84864bab18f" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-de969c89-fbc2-4da4-9382-08c31d081576 tempest-VolumesGetTest-1309011963 None] Lock "cinder-quobyte-20ff5653-74d0-42a6-a66a-c84864bab18f" acquired by "delete_volume" :: waited 0.048s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:50 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[9374f984-1852-4262-acc7-357e53512ac8]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-de969c89-fbc2-4da4-9382-08c31d081576 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-20ff5653-74d0-42a6-a66a-c84864bab18f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:50 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-098b1b7b-2c19-4353-9cdc-c772fc41675f tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.619s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:50 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-098b1b7b-2c19-4353-9cdc-c772fc41675f tempest-VolumesGetTest-1309011963 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:29:50 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-098b1b7b-2c19-4353-9cdc-c772fc41675f tempest-VolumesGetTest-1309011963 None] Deleted volume successfully. Nov 03 07:29:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-098b1b7b-2c19-4353-9cdc-c772fc41675f tempest-VolumesGetTest-1309011963 None] Lock "cinder-ce43f76e-d2c7-40bd-8b1d-b2be76ee3ab5-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:51 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-20ff5653-74d0-42a6-a66a-c84864bab18f Nov 03 07:29:51 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:51 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-a440835e-9501-4553-ab2c-e96e2af98883 req-c82053ba-c679-442e-82dc-a9a9d6191583 tempest-AttachVolumeNegativeTest-1666839905 None] Terminate volume connection completed successfully. Nov 03 07:29:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-a440835e-9501-4553-ab2c-e96e2af98883 req-c82053ba-c679-442e-82dc-a9a9d6191583 tempest-AttachVolumeNegativeTest-1666839905 None] Deleting attachment 3ddb63fa-77d7-4de8-a7d4-0e0024951fe4. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:29:51 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-de969c89-fbc2-4da4-9382-08c31d081576 tempest-VolumesGetTest-1309011963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-20ff5653-74d0-42a6-a66a-c84864bab18f" returned: 0 in 0.597s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-de969c89-fbc2-4da4-9382-08c31d081576 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-20ff5653-74d0-42a6-a66a-c84864bab18f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:51 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-20ff5653-74d0-42a6-a66a-c84864bab18f Nov 03 07:29:51 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:51 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-de969c89-fbc2-4da4-9382-08c31d081576 tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-20ff5653-74d0-42a6-a66a-c84864bab18f" returned: 0 in 0.280s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-de969c89-fbc2-4da4-9382-08c31d081576 tempest-VolumesGetTest-1309011963 None] Lock "cinder-quobyte-20ff5653-74d0-42a6-a66a-c84864bab18f" released by "delete_volume" :: held 1.026s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:51 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-de969c89-fbc2-4da4-9382-08c31d081576 tempest-VolumesGetTest-1309011963 None] Created reservations ['d2b68f2a-1875-4bdb-8f51-440c221d845b', '881c0913-e69b-4cdc-b12e-9fc770274537', '41b9211a-900e-4ade-b258-8356c42507f8', '943c0b12-2a19-49c3-83f1-e08d30e01ab6'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:29:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-de969c89-fbc2-4da4-9382-08c31d081576 tempest-VolumesGetTest-1309011963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-de969c89-fbc2-4da4-9382-08c31d081576 tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-de969c89-fbc2-4da4-9382-08c31d081576 tempest-VolumesGetTest-1309011963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:29:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-de969c89-fbc2-4da4-9382-08c31d081576 tempest-VolumesGetTest-1309011963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:29:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-de969c89-fbc2-4da4-9382-08c31d081576 tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-de969c89-fbc2-4da4-9382-08c31d081576 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:51 devstack sudo[95366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:29:51 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:52 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-de969c89-fbc2-4da4-9382-08c31d081576 tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.369s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:52 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-de969c89-fbc2-4da4-9382-08c31d081576 tempest-VolumesGetTest-1309011963 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:29:52 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-de969c89-fbc2-4da4-9382-08c31d081576 tempest-VolumesGetTest-1309011963 None] Deleted volume successfully. Nov 03 07:29:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-de969c89-fbc2-4da4-9382-08c31d081576 tempest-VolumesGetTest-1309011963 None] Lock "cinder-20ff5653-74d0-42a6-a66a-c84864bab18f-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-16a220e3-3871-4922-a356-6311859ce543 tempest-VolumesGetTest-1309011963 None] Acquiring lock "cinder-4feb1f36-e6e8-48be-b5ae-94a32a271332-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-16a220e3-3871-4922-a356-6311859ce543 tempest-VolumesGetTest-1309011963 None] Lock "cinder-4feb1f36-e6e8-48be-b5ae-94a32a271332-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-16a220e3-3871-4922-a356-6311859ce543 tempest-VolumesGetTest-1309011963 None] Acquiring lock "cinder-quobyte-4feb1f36-e6e8-48be-b5ae-94a32a271332" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-16a220e3-3871-4922-a356-6311859ce543 tempest-VolumesGetTest-1309011963 None] Lock "cinder-quobyte-4feb1f36-e6e8-48be-b5ae-94a32a271332" acquired by "delete_volume" :: waited 0.019s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:53 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4b2550-fb7d-45d8-879a-4899bb0e0de8]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-16a220e3-3871-4922-a356-6311859ce543 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:53 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332 Nov 03 07:29:53 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:53 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-16a220e3-3871-4922-a356-6311859ce543 tempest-VolumesGetTest-1309011963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332" returned: 0 in 0.726s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-16a220e3-3871-4922-a356-6311859ce543 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:53 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332 Nov 03 07:29:53 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:54 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-16a220e3-3871-4922-a356-6311859ce543 tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4feb1f36-e6e8-48be-b5ae-94a32a271332" returned: 0 in 0.577s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:54 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-16a220e3-3871-4922-a356-6311859ce543 tempest-VolumesGetTest-1309011963 None] Lock "cinder-quobyte-4feb1f36-e6e8-48be-b5ae-94a32a271332" released by "delete_volume" :: held 1.410s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:54 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-16a220e3-3871-4922-a356-6311859ce543 tempest-VolumesGetTest-1309011963 None] Created reservations ['2555bf5d-ade3-4ae9-bb7c-8570c99820fb', 'e4b52ead-0f0b-4c25-b894-f84b31d95af0', '6f1c5e8a-fd96-4e28-bff8-5141d0b29bc8', '4f1183e6-71bf-48ef-874e-ed2d02a3c8bf'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:29:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-16a220e3-3871-4922-a356-6311859ce543 tempest-VolumesGetTest-1309011963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-16a220e3-3871-4922-a356-6311859ce543 tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-16a220e3-3871-4922-a356-6311859ce543 tempest-VolumesGetTest-1309011963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:29:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-16a220e3-3871-4922-a356-6311859ce543 tempest-VolumesGetTest-1309011963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:29:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-16a220e3-3871-4922-a356-6311859ce543 tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-16a220e3-3871-4922-a356-6311859ce543 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:54 devstack sudo[95462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:29:54 devstack sudo[95462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:54 devstack sudo[95462]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-16a220e3-3871-4922-a356-6311859ce543 tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.316s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:55 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-16a220e3-3871-4922-a356-6311859ce543 tempest-VolumesGetTest-1309011963 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:29:55 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-16a220e3-3871-4922-a356-6311859ce543 tempest-VolumesGetTest-1309011963 None] Deleted volume successfully. Nov 03 07:29:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-16a220e3-3871-4922-a356-6311859ce543 tempest-VolumesGetTest-1309011963 None] Lock "cinder-4feb1f36-e6e8-48be-b5ae-94a32a271332-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:57 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:29:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Flow 'volume_create_manager' (417f6a1a-3b43-4da1-95dd-c852189e9175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:29:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ab0830-fbf9-45a1-aa0c-fd0d5b3da697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ab0830-fbf9-45a1-aa0c-fd0d5b3da697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2009609563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c0d6d18-fbaf-4006-b4ed-94692aaeee1a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13c1ca53184f48b2ade6da7c0d01bba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:29:57Z,use_quota=True,user_id='159aad2c4bca421fa588a10ab9998048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a1e4b4-9ec1-401c-ada3-98359c6ae3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a1e4b4-9ec1-401c-ada3-98359c6ae3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (589dd754-5cb7-432b-a668-582d0b8f0fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:57 devstack cinder-volume[87016]: DEBUG cinder.image.glance [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Creating Keystone auth plugin from conf {{(pid=87016) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:29:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (589dd754-5cb7-432b-a668-582d0b8f0fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0c0d6d18-fbaf-4006-b4ed-94692aaeee1a', 'volume_name': 'volume-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a', 'volume_size': 1, 'image_id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bde64ec799a64fc39c0407ed31a11129', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'created_at': datetime.datetime(2026, 11, 3, 6, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b35fdeb-423c-47d4-a38f-6ae1f675c183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b35fdeb-423c-47d4-a38f-6ae1f675c183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb9c6dc-6f8c-4b41-97d8-5277f741a82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:58 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Volume 0c0d6d18-fbaf-4006-b4ed-94692aaeee1a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a', 'volume_size': 1, 'image_id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bde64ec799a64fc39c0407ed31a11129', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'created_at': datetime.datetime(2026, 11, 3, 6, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 07:29:58 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Trying to clone 0c0d6d18-fbaf-4006-b4ed-94692aaeee1a from image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb at location (None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}]). {{(pid=87016) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:29:59 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_z0pj8glcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:29:59 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Image download 20.69 MB at 20.69 MB/s Nov 03 07:29:59 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[38105699-0324-4813-968f-e880582839a5]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_z0pj8glcdevstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:59 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_z0pj8glcdevstack@QuobyteHD Nov 03 07:29:59 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:59 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_z0pj8glcdevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:59 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Temporary image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb is fetched for user 159aad2c4bca421fa588a10ab9998048. {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:29:59 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d33c534-69b3-4914-a86c-739abd4ffd77]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_z0pj8glcdevstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:00 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_z0pj8glcdevstack@QuobyteHD Nov 03 07:30:00 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:00 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_z0pj8glcdevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2009609563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c0d6d18-fbaf-4006-b4ed-94692aaeee1a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13c1ca53184f48b2ade6da7c0d01bba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:29:57Z,use_quota=True,user_id='159aad2c4bca421fa588a10ab9998048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:30:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Creating volume 0c0d6d18-fbaf-4006-b4ed-94692aaeee1a {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:30:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:30:00 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:30:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:00 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a 1073741824 Nov 03 07:30:00 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:01 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a 1073741824" returned: 0 in 1.003s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:01 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a Nov 03 07:30:01 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:02 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a" returned: 0 in 0.472s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:02 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:30:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:02 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Attempting download of 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb ((None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}])) to volume 0c0d6d18-fbaf-4006-b4ed-94692aaeee1a. {{(pid=87016) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 03 07:30:02 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[740e3966-d5d3-496a-9a4b-baf3356308eb]: (4, 'raw') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_c2n5g7cs {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:02 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a01eb1fb-6fe3-445e-ac70-9db85049f866 tempest-AttachVolumeNegativeTest-1666839905 None] Acquiring lock "cinder-53f3d896-8489-4523-96aa-3a9b0f7291e9-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:02 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_c2n5g7cs Nov 03 07:30:02 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:02 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a01eb1fb-6fe3-445e-ac70-9db85049f866 tempest-AttachVolumeNegativeTest-1666839905 None] Lock "cinder-53f3d896-8489-4523-96aa-3a9b0f7291e9-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:02 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a01eb1fb-6fe3-445e-ac70-9db85049f866 tempest-AttachVolumeNegativeTest-1666839905 None] Acquiring lock "cinder-quobyte-53f3d896-8489-4523-96aa-3a9b0f7291e9" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:02 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a01eb1fb-6fe3-445e-ac70-9db85049f866 tempest-AttachVolumeNegativeTest-1666839905 None] Lock "cinder-quobyte-53f3d896-8489-4523-96aa-3a9b0f7291e9" acquired by "delete_volume" :: waited 0.040s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:02 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[d600a9ea-b551-4790-ac6c-65491da5d84d]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a01eb1fb-6fe3-445e-ac70-9db85049f866 tempest-AttachVolumeNegativeTest-1666839905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-53f3d896-8489-4523-96aa-3a9b0f7291e9 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:02 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_c2n5g7cs" returned: 0 in 0.796s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_c2n5g7cs {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:03 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-53f3d896-8489-4523-96aa-3a9b0f7291e9 Nov 03 07:30:03 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:03 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_c2n5g7cs Nov 03 07:30:03 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:03 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_c2n5g7cs" returned: 1 in 0.673s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_c2n5g7cs' failed. Not Retrying. {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:30:03 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bac1110-a912-4f07-9151-a15a8cc74e19]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_z0pj8glcdevstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:03 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a01eb1fb-6fe3-445e-ac70-9db85049f866 tempest-AttachVolumeNegativeTest-1666839905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-53f3d896-8489-4523-96aa-3a9b0f7291e9" returned: 0 in 0.904s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a01eb1fb-6fe3-445e-ac70-9db85049f866 tempest-AttachVolumeNegativeTest-1666839905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-53f3d896-8489-4523-96aa-3a9b0f7291e9 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:03 devstack sudo[95541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-53f3d896-8489-4523-96aa-3a9b0f7291e9 Nov 03 07:30:03 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:04 devstack sudo[95540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_z0pj8glcdevstack@QuobyteHD Nov 03 07:30:04 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:04 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_z0pj8glcdevstack@QuobyteHD" returned: 0 in 0.843s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:04 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb was qcow2, converting to qcow2 {{(pid=87016) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:30:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_z0pj8glcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:04 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_z0pj8glcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a Nov 03 07:30:04 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:04 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a01eb1fb-6fe3-445e-ac70-9db85049f866 tempest-AttachVolumeNegativeTest-1666839905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-53f3d896-8489-4523-96aa-3a9b0f7291e9" returned: 0 in 0.870s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a01eb1fb-6fe3-445e-ac70-9db85049f866 tempest-AttachVolumeNegativeTest-1666839905 None] Lock "cinder-quobyte-53f3d896-8489-4523-96aa-3a9b0f7291e9" released by "delete_volume" :: held 1.874s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:04 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-a01eb1fb-6fe3-445e-ac70-9db85049f866 tempest-AttachVolumeNegativeTest-1666839905 None] Created reservations ['3a954269-a59f-4cb5-909b-4caa03b8dd24', '05ec2634-5822-452d-9b1f-24e608146f16', 'e413b0ce-e2be-45ba-a429-95c8f6c494db', '299c9419-15db-45ee-a4f1-3bf270275c11'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:30:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a01eb1fb-6fe3-445e-ac70-9db85049f866 tempest-AttachVolumeNegativeTest-1666839905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a01eb1fb-6fe3-445e-ac70-9db85049f866 tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a01eb1fb-6fe3-445e-ac70-9db85049f866 tempest-AttachVolumeNegativeTest-1666839905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a01eb1fb-6fe3-445e-ac70-9db85049f866 tempest-AttachVolumeNegativeTest-1666839905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a01eb1fb-6fe3-445e-ac70-9db85049f866 tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a01eb1fb-6fe3-445e-ac70-9db85049f866 tempest-AttachVolumeNegativeTest-1666839905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:05 devstack sudo[95572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:30:05 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b001e05e-ebd0-43ec-acf9-708261f61ec8 tempest-AttachVolumeNegativeTest-1666839905 None] Acquiring lock "cinder-68c30be9-2289-4886-b80d-d71e1ada24d2-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b001e05e-ebd0-43ec-acf9-708261f61ec8 tempest-AttachVolumeNegativeTest-1666839905 None] Lock "cinder-68c30be9-2289-4886-b80d-d71e1ada24d2-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b001e05e-ebd0-43ec-acf9-708261f61ec8 tempest-AttachVolumeNegativeTest-1666839905 None] Acquiring lock "cinder-quobyte-68c30be9-2289-4886-b80d-d71e1ada24d2" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b001e05e-ebd0-43ec-acf9-708261f61ec8 tempest-AttachVolumeNegativeTest-1666839905 None] Lock "cinder-quobyte-68c30be9-2289-4886-b80d-d71e1ada24d2" acquired by "delete_volume" :: waited 0.056s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:05 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53d2c88-64c0-4421-8cdf-2d12d9fd0d06]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b001e05e-ebd0-43ec-acf9-708261f61ec8 tempest-AttachVolumeNegativeTest-1666839905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-68c30be9-2289-4886-b80d-d71e1ada24d2 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:06 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a01eb1fb-6fe3-445e-ac70-9db85049f866 tempest-AttachVolumeNegativeTest-1666839905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.982s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:06 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a01eb1fb-6fe3-445e-ac70-9db85049f866 tempest-AttachVolumeNegativeTest-1666839905 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:30:06 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a01eb1fb-6fe3-445e-ac70-9db85049f866 tempest-AttachVolumeNegativeTest-1666839905 None] Deleted volume successfully. Nov 03 07:30:06 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a01eb1fb-6fe3-445e-ac70-9db85049f866 tempest-AttachVolumeNegativeTest-1666839905 None] Lock "cinder-53f3d896-8489-4523-96aa-3a9b0f7291e9-delete_volume" released by "delete_volume" :: held 3.522s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:06 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-68c30be9-2289-4886-b80d-d71e1ada24d2 Nov 03 07:30:06 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:07 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b001e05e-ebd0-43ec-acf9-708261f61ec8 tempest-AttachVolumeNegativeTest-1666839905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-68c30be9-2289-4886-b80d-d71e1ada24d2" returned: 0 in 1.169s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b001e05e-ebd0-43ec-acf9-708261f61ec8 tempest-AttachVolumeNegativeTest-1666839905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-68c30be9-2289-4886-b80d-d71e1ada24d2 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:07 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-68c30be9-2289-4886-b80d-d71e1ada24d2 Nov 03 07:30:07 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:07 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b001e05e-ebd0-43ec-acf9-708261f61ec8 tempest-AttachVolumeNegativeTest-1666839905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-68c30be9-2289-4886-b80d-d71e1ada24d2" returned: 0 in 0.645s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:07 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b001e05e-ebd0-43ec-acf9-708261f61ec8 tempest-AttachVolumeNegativeTest-1666839905 None] Lock "cinder-quobyte-68c30be9-2289-4886-b80d-d71e1ada24d2" released by "delete_volume" :: held 1.928s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:07 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-b001e05e-ebd0-43ec-acf9-708261f61ec8 tempest-AttachVolumeNegativeTest-1666839905 None] Created reservations ['07bf19e7-c6e2-485f-a95e-e001968b9b3b', '09fe3d4f-fef5-414f-977d-4a4d6cd40509', '1907b694-705f-4124-b203-eb28dbd7d9f7', '9811128e-d288-43fd-a014-80ae298736a6'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:30:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b001e05e-ebd0-43ec-acf9-708261f61ec8 tempest-AttachVolumeNegativeTest-1666839905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b001e05e-ebd0-43ec-acf9-708261f61ec8 tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b001e05e-ebd0-43ec-acf9-708261f61ec8 tempest-AttachVolumeNegativeTest-1666839905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b001e05e-ebd0-43ec-acf9-708261f61ec8 tempest-AttachVolumeNegativeTest-1666839905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b001e05e-ebd0-43ec-acf9-708261f61ec8 tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b001e05e-ebd0-43ec-acf9-708261f61ec8 tempest-AttachVolumeNegativeTest-1666839905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:08 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:30:08 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:08 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_z0pj8glcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a" returned: 0 in 4.190s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:08 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_z0pj8glcdevstack@QuobyteHD, size 112.00 MB, duration 4.19 sec, destination /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:30:08 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Converted 112.00 MB image at 26.72 MB/s Nov 03 07:30:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:08 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a 1G Nov 03 07:30:08 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:08 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b001e05e-ebd0-43ec-acf9-708261f61ec8 tempest-AttachVolumeNegativeTest-1666839905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.648s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:08 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-b001e05e-ebd0-43ec-acf9-708261f61ec8 tempest-AttachVolumeNegativeTest-1666839905 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:30:08 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b001e05e-ebd0-43ec-acf9-708261f61ec8 tempest-AttachVolumeNegativeTest-1666839905 None] Deleted volume successfully. Nov 03 07:30:08 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b001e05e-ebd0-43ec-acf9-708261f61ec8 tempest-AttachVolumeNegativeTest-1666839905 None] Lock "cinder-68c30be9-2289-4886-b80d-d71e1ada24d2-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:09 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6a039f05-ee13-4da2-9c66-25c2473c144a tempest-AttachVolumeNegativeTest-1666839905 None] Acquiring lock "cinder-99163771-bc1a-425f-a111-9c7c71ccec49-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:09 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6a039f05-ee13-4da2-9c66-25c2473c144a tempest-AttachVolumeNegativeTest-1666839905 None] Lock "cinder-99163771-bc1a-425f-a111-9c7c71ccec49-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:09 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6a039f05-ee13-4da2-9c66-25c2473c144a tempest-AttachVolumeNegativeTest-1666839905 None] Acquiring lock "cinder-quobyte-99163771-bc1a-425f-a111-9c7c71ccec49" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:09 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6a039f05-ee13-4da2-9c66-25c2473c144a tempest-AttachVolumeNegativeTest-1666839905 None] Lock "cinder-quobyte-99163771-bc1a-425f-a111-9c7c71ccec49" acquired by "delete_volume" :: waited 0.032s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:09 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[485a5404-72c7-42bd-8ada-1c358033e47b]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6a039f05-ee13-4da2-9c66-25c2473c144a tempest-AttachVolumeNegativeTest-1666839905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-99163771-bc1a-425f-a111-9c7c71ccec49 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:09 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-99163771-bc1a-425f-a111-9c7c71ccec49 Nov 03 07:30:09 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:09 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a 1G" returned: 0 in 0.816s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:09 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Downloaded image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb ((None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}])) to volume 0c0d6d18-fbaf-4006-b4ed-94692aaeee1a successfully. {{(pid=87016) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 03 07:30:09 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Temporary image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb for user 159aad2c4bca421fa588a10ab9998048 is deleted. {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:30:09 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Marking volume 0c0d6d18-fbaf-4006-b4ed-94692aaeee1a as bootable. {{(pid=87016) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 03 07:30:09 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Copying metadata from image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb to 0c0d6d18-fbaf-4006-b4ed-94692aaeee1a. {{(pid=87016) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:30:09 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Creating volume glance metadata for volume 0c0d6d18-fbaf-4006-b4ed-94692aaeee1a backed by image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87016) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:30:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb9c6dc-6f8c-4b41-97d8-5277f741a82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a', 'volume_size': 1, 'image_id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bde64ec799a64fc39c0407ed31a11129', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'created_at': datetime.datetime(2026, 11, 3, 6, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4290dd85-7acd-4ada-ae6d-0b75d724f072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:09 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Volume volume-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a (0c0d6d18-fbaf-4006-b4ed-94692aaeee1a): created successfully Nov 03 07:30:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4290dd85-7acd-4ada-ae6d-0b75d724f072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Flow 'volume_create_manager' (417f6a1a-3b43-4da1-95dd-c852189e9175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:09 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-68cf1b1b-d692-4f3d-8d89-1d6c6b369daa tempest-VolumesGetTest-1309011963 None] Created volume successfully. Nov 03 07:30:10 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6a039f05-ee13-4da2-9c66-25c2473c144a tempest-AttachVolumeNegativeTest-1666839905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-99163771-bc1a-425f-a111-9c7c71ccec49" returned: 0 in 0.749s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6a039f05-ee13-4da2-9c66-25c2473c144a tempest-AttachVolumeNegativeTest-1666839905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-99163771-bc1a-425f-a111-9c7c71ccec49 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:10 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-99163771-bc1a-425f-a111-9c7c71ccec49 Nov 03 07:30:10 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:10 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6a039f05-ee13-4da2-9c66-25c2473c144a tempest-AttachVolumeNegativeTest-1666839905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-99163771-bc1a-425f-a111-9c7c71ccec49" returned: 0 in 0.376s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:10 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6a039f05-ee13-4da2-9c66-25c2473c144a tempest-AttachVolumeNegativeTest-1666839905 None] Lock "cinder-quobyte-99163771-bc1a-425f-a111-9c7c71ccec49" released by "delete_volume" :: held 1.236s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:10 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-6a039f05-ee13-4da2-9c66-25c2473c144a tempest-AttachVolumeNegativeTest-1666839905 None] Created reservations ['e7bab657-ceff-4b1e-97f7-c12d77bf4fa4', '56ec701d-8812-43ad-8e77-e2045bc8628c', '6c6f9e90-5134-482f-ae3d-4615eacbd8e6', 'd0048965-12d9-465d-b17e-5dff1d035e74'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:30:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6a039f05-ee13-4da2-9c66-25c2473c144a tempest-AttachVolumeNegativeTest-1666839905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6a039f05-ee13-4da2-9c66-25c2473c144a tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6a039f05-ee13-4da2-9c66-25c2473c144a tempest-AttachVolumeNegativeTest-1666839905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6a039f05-ee13-4da2-9c66-25c2473c144a tempest-AttachVolumeNegativeTest-1666839905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6a039f05-ee13-4da2-9c66-25c2473c144a tempest-AttachVolumeNegativeTest-1666839905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6a039f05-ee13-4da2-9c66-25c2473c144a tempest-AttachVolumeNegativeTest-1666839905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:10 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:30:10 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:11 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6a039f05-ee13-4da2-9c66-25c2473c144a tempest-AttachVolumeNegativeTest-1666839905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.503s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:11 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-6a039f05-ee13-4da2-9c66-25c2473c144a tempest-AttachVolumeNegativeTest-1666839905 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:30:11 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-6a039f05-ee13-4da2-9c66-25c2473c144a tempest-AttachVolumeNegativeTest-1666839905 None] Deleted volume successfully. Nov 03 07:30:11 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6a039f05-ee13-4da2-9c66-25c2473c144a tempest-AttachVolumeNegativeTest-1666839905 None] Lock "cinder-99163771-bc1a-425f-a111-9c7c71ccec49-delete_volume" released by "delete_volume" :: held 2.110s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:12 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:30:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Flow 'volume_create_manager' (189a02be-71b0-42a6-9e86-65357f96874e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77dd49d5-0a00-489a-86e9-4d2a68034632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77dd49d5-0a00-489a-86e9-4d2a68034632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-17992978',display_name='tempest-VolumesGetTest-Volume-1130615514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d99a4e40-1a07-4f2f-a5fa-7305d73965bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c1ca53184f48b2ade6da7c0d01bba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:13Z,use_quota=True,user_id='159aad2c4bca421fa588a10ab9998048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7107cfe3-ac06-4627-b287-445feb4ecc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7107cfe3-ac06-4627-b287-445feb4ecc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a1523a-e01e-42ea-99a9-7b00c0b7edfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a1523a-e01e-42ea-99a9-7b00c0b7edfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd99a4e40-1a07-4f2f-a5fa-7305d73965bd', 'volume_name': 'volume-d99a4e40-1a07-4f2f-a5fa-7305d73965bd', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6bdb2a-8f09-4782-828a-b2012bc0a00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6bdb2a-8f09-4782-828a-b2012bc0a00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5bcab2b-c44f-42d4-8ea7-3ec48da5e629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:12 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Volume d99a4e40-1a07-4f2f-a5fa-7305d73965bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d99a4e40-1a07-4f2f-a5fa-7305d73965bd', 'volume_size': 1} Nov 03 07:30:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-17992978',display_name='tempest-VolumesGetTest-Volume-1130615514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d99a4e40-1a07-4f2f-a5fa-7305d73965bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c1ca53184f48b2ade6da7c0d01bba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:13Z,use_quota=True,user_id='159aad2c4bca421fa588a10ab9998048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:30:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Creating volume d99a4e40-1a07-4f2f-a5fa-7305d73965bd {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:30:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:30:12 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:30:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d99a4e40-1a07-4f2f-a5fa-7305d73965bd 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:12 devstack sudo[95671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d99a4e40-1a07-4f2f-a5fa-7305d73965bd 1073741824 Nov 03 07:30:12 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:13 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d99a4e40-1a07-4f2f-a5fa-7305d73965bd 1073741824" returned: 0 in 1.002s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d99a4e40-1a07-4f2f-a5fa-7305d73965bd {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:14 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d99a4e40-1a07-4f2f-a5fa-7305d73965bd Nov 03 07:30:14 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:14 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d99a4e40-1a07-4f2f-a5fa-7305d73965bd" returned: 0 in 0.513s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:30:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5bcab2b-c44f-42d4-8ea7-3ec48da5e629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d99a4e40-1a07-4f2f-a5fa-7305d73965bd', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2807e07a-07bd-4fc6-b5d5-19fb9ce64a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:14 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Volume volume-d99a4e40-1a07-4f2f-a5fa-7305d73965bd (d99a4e40-1a07-4f2f-a5fa-7305d73965bd): created successfully Nov 03 07:30:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2807e07a-07bd-4fc6-b5d5-19fb9ce64a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Flow 'volume_create_manager' (189a02be-71b0-42a6-9e86-65357f96874e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:14 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-912d8f61-c0a0-4575-adc5-aafb3605b0f7 tempest-VolumesGetTest-1309011963 None] Created volume successfully. Nov 03 07:30:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-42ee7d39-a1f2-449b-9d84-11f30f4692d4 tempest-VolumesGetTest-1309011963 None] Acquiring lock "cinder-d99a4e40-1a07-4f2f-a5fa-7305d73965bd-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-42ee7d39-a1f2-449b-9d84-11f30f4692d4 tempest-VolumesGetTest-1309011963 None] Lock "cinder-d99a4e40-1a07-4f2f-a5fa-7305d73965bd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-42ee7d39-a1f2-449b-9d84-11f30f4692d4 tempest-VolumesGetTest-1309011963 None] Acquiring lock "cinder-quobyte-d99a4e40-1a07-4f2f-a5fa-7305d73965bd" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-42ee7d39-a1f2-449b-9d84-11f30f4692d4 tempest-VolumesGetTest-1309011963 None] Lock "cinder-quobyte-d99a4e40-1a07-4f2f-a5fa-7305d73965bd" acquired by "delete_volume" :: waited 0.028s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:15 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b43d31-c7b3-4355-9b42-d5c460546929]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-42ee7d39-a1f2-449b-9d84-11f30f4692d4 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d99a4e40-1a07-4f2f-a5fa-7305d73965bd {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:15 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d99a4e40-1a07-4f2f-a5fa-7305d73965bd Nov 03 07:30:15 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-42ee7d39-a1f2-449b-9d84-11f30f4692d4 tempest-VolumesGetTest-1309011963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d99a4e40-1a07-4f2f-a5fa-7305d73965bd" returned: 0 in 0.640s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-42ee7d39-a1f2-449b-9d84-11f30f4692d4 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d99a4e40-1a07-4f2f-a5fa-7305d73965bd {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:16 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:16 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d99a4e40-1a07-4f2f-a5fa-7305d73965bd Nov 03 07:30:16 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:16 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-42ee7d39-a1f2-449b-9d84-11f30f4692d4 tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d99a4e40-1a07-4f2f-a5fa-7305d73965bd" returned: 0 in 0.744s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:16 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-42ee7d39-a1f2-449b-9d84-11f30f4692d4 tempest-VolumesGetTest-1309011963 None] Lock "cinder-quobyte-d99a4e40-1a07-4f2f-a5fa-7305d73965bd" released by "delete_volume" :: held 1.464s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:17 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-42ee7d39-a1f2-449b-9d84-11f30f4692d4 tempest-VolumesGetTest-1309011963 None] Created reservations ['87dad756-8a61-47ba-a3ef-f6d4cc0c0947', '050e0fce-5b91-4990-bbef-b225dc37d52a', '9dd4982d-eeed-43e9-956d-873b2fb53a59', '38d2785d-d7f0-4d46-bc4b-7fb9b8efe7b6'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:30:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-42ee7d39-a1f2-449b-9d84-11f30f4692d4 tempest-VolumesGetTest-1309011963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-42ee7d39-a1f2-449b-9d84-11f30f4692d4 tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:17 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-42ee7d39-a1f2-449b-9d84-11f30f4692d4 tempest-VolumesGetTest-1309011963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:17 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-42ee7d39-a1f2-449b-9d84-11f30f4692d4 tempest-VolumesGetTest-1309011963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-42ee7d39-a1f2-449b-9d84-11f30f4692d4 tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.060s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-42ee7d39-a1f2-449b-9d84-11f30f4692d4 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:17 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:30:17 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:18 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-42ee7d39-a1f2-449b-9d84-11f30f4692d4 tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.756s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:18 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-42ee7d39-a1f2-449b-9d84-11f30f4692d4 tempest-VolumesGetTest-1309011963 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:30:18 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-42ee7d39-a1f2-449b-9d84-11f30f4692d4 tempest-VolumesGetTest-1309011963 None] Deleted volume successfully. Nov 03 07:30:18 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-11e85904-0918-4005-aacc-b7ef6a2d3a90 tempest-VolumesGetTest-1309011963 None] Acquiring lock "cinder-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:18 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-11e85904-0918-4005-aacc-b7ef6a2d3a90 tempest-VolumesGetTest-1309011963 None] Lock "cinder-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:18 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-42ee7d39-a1f2-449b-9d84-11f30f4692d4 tempest-VolumesGetTest-1309011963 None] Lock "cinder-d99a4e40-1a07-4f2f-a5fa-7305d73965bd-delete_volume" released by "delete_volume" :: held 2.815s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:18 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-11e85904-0918-4005-aacc-b7ef6a2d3a90 tempest-VolumesGetTest-1309011963 None] Acquiring lock "cinder-quobyte-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:18 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-11e85904-0918-4005-aacc-b7ef6a2d3a90 tempest-VolumesGetTest-1309011963 None] Lock "cinder-quobyte-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a" acquired by "delete_volume" :: waited 0.079s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:18 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[c062a992-1d05-4af5-a992-9884766177c1]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-11e85904-0918-4005-aacc-b7ef6a2d3a90 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:18 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a Nov 03 07:30:18 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:19 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-11e85904-0918-4005-aacc-b7ef6a2d3a90 tempest-VolumesGetTest-1309011963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a" returned: 0 in 0.698s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-11e85904-0918-4005-aacc-b7ef6a2d3a90 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:19 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a Nov 03 07:30:19 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:19 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-11e85904-0918-4005-aacc-b7ef6a2d3a90 tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a" returned: 0 in 0.446s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-11e85904-0918-4005-aacc-b7ef6a2d3a90 tempest-VolumesGetTest-1309011963 None] Lock "cinder-quobyte-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a" released by "delete_volume" :: held 1.272s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:19 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-11e85904-0918-4005-aacc-b7ef6a2d3a90 tempest-VolumesGetTest-1309011963 None] Created reservations ['cd5fab91-30de-4c6a-a73a-1e29106b71de', 'de824fb1-b70a-4e15-a607-3fbe8d27c612', '6b2f7c8c-a332-4be7-ba63-177a4700592a', '92d57d69-6b48-42d2-9b38-a5bad315ca26'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:30:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-11e85904-0918-4005-aacc-b7ef6a2d3a90 tempest-VolumesGetTest-1309011963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-11e85904-0918-4005-aacc-b7ef6a2d3a90 tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-11e85904-0918-4005-aacc-b7ef6a2d3a90 tempest-VolumesGetTest-1309011963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-11e85904-0918-4005-aacc-b7ef6a2d3a90 tempest-VolumesGetTest-1309011963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-11e85904-0918-4005-aacc-b7ef6a2d3a90 tempest-VolumesGetTest-1309011963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-11e85904-0918-4005-aacc-b7ef6a2d3a90 tempest-VolumesGetTest-1309011963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:19 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:30:19 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:20 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-11e85904-0918-4005-aacc-b7ef6a2d3a90 tempest-VolumesGetTest-1309011963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.316s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:20 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-11e85904-0918-4005-aacc-b7ef6a2d3a90 tempest-VolumesGetTest-1309011963 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:30:20 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-11e85904-0918-4005-aacc-b7ef6a2d3a90 tempest-VolumesGetTest-1309011963 None] Deleted volume successfully. Nov 03 07:30:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-11e85904-0918-4005-aacc-b7ef6a2d3a90 tempest-VolumesGetTest-1309011963 None] Lock "cinder-0c0d6d18-fbaf-4006-b4ed-94692aaeee1a-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:22 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:30:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Flow 'volume_create_manager' (65231126-d857-4d2b-9c55-46d93fa62adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ec000d-b1fa-4134-9efb-7cb39a3fae6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ec000d-b1fa-4134-9efb-7cb39a3fae6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1143757023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f5418ad3314d74886d163d3d51e26a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:22Z,use_quota=True,user_id='c472a4d4f2914af581095f0d9cbea973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872519b0-74cf-425e-be0b-70a85c820a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872519b0-74cf-425e-be0b-70a85c820a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f97e40-1aae-41b7-85dc-e3af647f523f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f97e40-1aae-41b7-85dc-e3af647f523f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf', 'volume_name': 'volume-eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dfdc25a-29d2-4584-8e60-e18092c229b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dfdc25a-29d2-4584-8e60-e18092c229b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3807ce59-f1df-415d-a366-91a0c8e46916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:22 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Volume eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf', 'volume_size': 1} Nov 03 07:30:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:22 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1143757023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f5418ad3314d74886d163d3d51e26a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:22Z,use_quota=True,user_id='c472a4d4f2914af581095f0d9cbea973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:30:22 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Creating volume eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:30:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:22 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:22 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:22 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:30:22 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:30:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:22 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf 1073741824 Nov 03 07:30:22 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:22 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf 1073741824" returned: 0 in 0.694s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:23 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf Nov 03 07:30:23 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:23 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf" returned: 0 in 0.540s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:30:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3807ce59-f1df-415d-a366-91a0c8e46916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0844773c-b7fb-4dc8-886a-9d6544ae4c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:23 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Volume volume-eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf (eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf): created successfully Nov 03 07:30:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0844773c-b7fb-4dc8-886a-9d6544ae4c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Flow 'volume_create_manager' (65231126-d857-4d2b-9c55-46d93fa62adc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:23 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-dd781563-6771-4689-a622-5d38ebf7df6e tempest-ServersNegativeTestJSON-534171205 None] Created volume successfully. Nov 03 07:30:28 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:30:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Flow 'volume_create_manager' (4b1d5a20-6f7f-4803-a517-b5ef73d50a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3fe472-c97c-41a5-a204-35c297eecbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3fe472-c97c-41a5-a204-35c297eecbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-966868467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e060596-e463-4988-928c-11a22f5b5234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f5418ad3314d74886d163d3d51e26a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:28Z,use_quota=True,user_id='c472a4d4f2914af581095f0d9cbea973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e448b861-b9d4-4b21-a1db-edc717d48d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e448b861-b9d4-4b21-a1db-edc717d48d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f28097f-3cf5-4f60-a627-2151b1e14d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f28097f-3cf5-4f60-a627-2151b1e14d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e060596-e463-4988-928c-11a22f5b5234', 'volume_name': 'volume-4e060596-e463-4988-928c-11a22f5b5234', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9471eab6-f06b-4501-8a7c-7023b9df5751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9471eab6-f06b-4501-8a7c-7023b9df5751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (809c11fd-26d3-4402-b8a7-431741409937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:28 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Volume 4e060596-e463-4988-928c-11a22f5b5234: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e060596-e463-4988-928c-11a22f5b5234', 'volume_size': 1} Nov 03 07:30:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-966868467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e060596-e463-4988-928c-11a22f5b5234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f5418ad3314d74886d163d3d51e26a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:28Z,use_quota=True,user_id='c472a4d4f2914af581095f0d9cbea973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:30:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Creating volume 4e060596-e463-4988-928c-11a22f5b5234 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:30:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:30:28 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:30:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e060596-e463-4988-928c-11a22f5b5234 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:28 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e060596-e463-4988-928c-11a22f5b5234 1073741824 Nov 03 07:30:28 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:29 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e060596-e463-4988-928c-11a22f5b5234 1073741824" returned: 0 in 1.144s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e060596-e463-4988-928c-11a22f5b5234 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:29 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e060596-e463-4988-928c-11a22f5b5234 Nov 03 07:30:29 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:30 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e060596-e463-4988-928c-11a22f5b5234" returned: 0 in 0.555s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:30:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (809c11fd-26d3-4402-b8a7-431741409937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e060596-e463-4988-928c-11a22f5b5234', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6eea12-c51d-48ab-a478-ff9b29a7dd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:30 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Volume volume-4e060596-e463-4988-928c-11a22f5b5234 (4e060596-e463-4988-928c-11a22f5b5234): created successfully Nov 03 07:30:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6eea12-c51d-48ab-a478-ff9b29a7dd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Flow 'volume_create_manager' (4b1d5a20-6f7f-4803-a517-b5ef73d50a49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:30 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-d4420cde-8151-45b8-a7f1-77dda0b9de03 tempest-ServersNegativeTestJSON-534171205 None] Created volume successfully. Nov 03 07:30:32 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-4b09cdc7-4128-4f5e-ba26-14aed28729f5 tempest-GroupsV320Test-317259965 None] Group tempest-GroupsV320Test-Group-858326365: creating Nov 03 07:30:32 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-4b09cdc7-4128-4f5e-ba26-14aed28729f5 tempest-GroupsV320Test-317259965 None] Group tempest-GroupsV320Test-Group-858326365: created successfully Nov 03 07:30:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-37f40a42-4ffd-48eb-82a4-6d81538c689a tempest-ServersNegativeTestJSON-534171205 None] Acquiring lock "cinder-4e060596-e463-4988-928c-11a22f5b5234-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:32 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-4b09cdc7-4128-4f5e-ba26-14aed28729f5 tempest-GroupsV320Test-317259965 None] Create group completed successfully. Nov 03 07:30:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-37f40a42-4ffd-48eb-82a4-6d81538c689a tempest-ServersNegativeTestJSON-534171205 None] Lock "cinder-4e060596-e463-4988-928c-11a22f5b5234-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-37f40a42-4ffd-48eb-82a4-6d81538c689a tempest-ServersNegativeTestJSON-534171205 None] Acquiring lock "cinder-quobyte-4e060596-e463-4988-928c-11a22f5b5234" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-37f40a42-4ffd-48eb-82a4-6d81538c689a tempest-ServersNegativeTestJSON-534171205 None] Lock "cinder-quobyte-4e060596-e463-4988-928c-11a22f5b5234" acquired by "delete_volume" :: waited 0.018s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:32 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68a789f-c72d-4915-be75-8822d07f8e6f]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-37f40a42-4ffd-48eb-82a4-6d81538c689a tempest-ServersNegativeTestJSON-534171205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e060596-e463-4988-928c-11a22f5b5234 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:32 devstack sudo[95896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e060596-e463-4988-928c-11a22f5b5234 Nov 03 07:30:32 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:33 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-37f40a42-4ffd-48eb-82a4-6d81538c689a tempest-ServersNegativeTestJSON-534171205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e060596-e463-4988-928c-11a22f5b5234" returned: 0 in 0.396s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-37f40a42-4ffd-48eb-82a4-6d81538c689a tempest-ServersNegativeTestJSON-534171205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e060596-e463-4988-928c-11a22f5b5234 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:33 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e060596-e463-4988-928c-11a22f5b5234 Nov 03 07:30:33 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:33 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-37f40a42-4ffd-48eb-82a4-6d81538c689a tempest-ServersNegativeTestJSON-534171205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e060596-e463-4988-928c-11a22f5b5234" returned: 0 in 0.317s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-37f40a42-4ffd-48eb-82a4-6d81538c689a tempest-ServersNegativeTestJSON-534171205 None] Lock "cinder-quobyte-4e060596-e463-4988-928c-11a22f5b5234" released by "delete_volume" :: held 0.810s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:33 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-37f40a42-4ffd-48eb-82a4-6d81538c689a tempest-ServersNegativeTestJSON-534171205 None] Created reservations ['6a85a2ba-ec7c-4ce9-a59d-c3770a014a6d', '64b14f03-7cbb-40d9-ae89-447b1ef24871', 'c267b708-a1fc-4aa2-ac4d-8292d3ac759b', '2ede4cf0-04b5-49b9-98de-de6be8477b47'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:30:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-37f40a42-4ffd-48eb-82a4-6d81538c689a tempest-ServersNegativeTestJSON-534171205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-37f40a42-4ffd-48eb-82a4-6d81538c689a tempest-ServersNegativeTestJSON-534171205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-37f40a42-4ffd-48eb-82a4-6d81538c689a tempest-ServersNegativeTestJSON-534171205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-37f40a42-4ffd-48eb-82a4-6d81538c689a tempest-ServersNegativeTestJSON-534171205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-37f40a42-4ffd-48eb-82a4-6d81538c689a tempest-ServersNegativeTestJSON-534171205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-37f40a42-4ffd-48eb-82a4-6d81538c689a tempest-ServersNegativeTestJSON-534171205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:33 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:30:33 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6d41a09b-d999-4788-9c23-2bb987128539 tempest-ServersNegativeTestJSON-534171205 None] Acquiring lock "cinder-eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6d41a09b-d999-4788-9c23-2bb987128539 tempest-ServersNegativeTestJSON-534171205 None] Lock "cinder-eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6d41a09b-d999-4788-9c23-2bb987128539 tempest-ServersNegativeTestJSON-534171205 None] Acquiring lock "cinder-quobyte-eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6d41a09b-d999-4788-9c23-2bb987128539 tempest-ServersNegativeTestJSON-534171205 None] Lock "cinder-quobyte-eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf" acquired by "delete_volume" :: waited 0.026s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:34 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[093a93c3-10b8-4ae7-ab6e-1bc8d25fb74a]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6d41a09b-d999-4788-9c23-2bb987128539 tempest-ServersNegativeTestJSON-534171205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:34 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-37f40a42-4ffd-48eb-82a4-6d81538c689a tempest-ServersNegativeTestJSON-534171205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.550s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:34 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-37f40a42-4ffd-48eb-82a4-6d81538c689a tempest-ServersNegativeTestJSON-534171205 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:30:34 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-37f40a42-4ffd-48eb-82a4-6d81538c689a tempest-ServersNegativeTestJSON-534171205 None] Deleted volume successfully. Nov 03 07:30:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-37f40a42-4ffd-48eb-82a4-6d81538c689a tempest-ServersNegativeTestJSON-534171205 None] Lock "cinder-4e060596-e463-4988-928c-11a22f5b5234-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:34 devstack sudo[95906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf Nov 03 07:30:34 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:34 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-4da53be8-e31a-4f13-81ff-f73beaa6f3ec tempest-GroupsV320Test-317259965 None] Created reservations ['c77bf31a-ba8f-4236-a56c-1f68da512f43'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:30:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4da53be8-e31a-4f13-81ff-f73beaa6f3ec tempest-GroupsV320Test-317259965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4da53be8-e31a-4f13-81ff-f73beaa6f3ec tempest-GroupsV320Test-317259965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4da53be8-e31a-4f13-81ff-f73beaa6f3ec tempest-GroupsV320Test-317259965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4da53be8-e31a-4f13-81ff-f73beaa6f3ec tempest-GroupsV320Test-317259965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4da53be8-e31a-4f13-81ff-f73beaa6f3ec tempest-GroupsV320Test-317259965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4da53be8-e31a-4f13-81ff-f73beaa6f3ec tempest-GroupsV320Test-317259965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:34 devstack sudo[95911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:30:34 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:34 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6d41a09b-d999-4788-9c23-2bb987128539 tempest-ServersNegativeTestJSON-534171205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf" returned: 0 in 0.673s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6d41a09b-d999-4788-9c23-2bb987128539 tempest-ServersNegativeTestJSON-534171205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:34 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf Nov 03 07:30:34 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:35 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4da53be8-e31a-4f13-81ff-f73beaa6f3ec tempest-GroupsV320Test-317259965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.310s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:35 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-4da53be8-e31a-4f13-81ff-f73beaa6f3ec tempest-GroupsV320Test-317259965 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:30:35 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-4da53be8-e31a-4f13-81ff-f73beaa6f3ec tempest-GroupsV320Test-317259965 None] Delete group completed successfully. Nov 03 07:30:35 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6d41a09b-d999-4788-9c23-2bb987128539 tempest-ServersNegativeTestJSON-534171205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf" returned: 0 in 0.419s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6d41a09b-d999-4788-9c23-2bb987128539 tempest-ServersNegativeTestJSON-534171205 None] Lock "cinder-quobyte-eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf" released by "delete_volume" :: held 1.179s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:35 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-6d41a09b-d999-4788-9c23-2bb987128539 tempest-ServersNegativeTestJSON-534171205 None] Created reservations ['652527e4-da58-40e8-b49c-bfb61cb0293a', '4117c7d9-79ee-41be-8057-a61c82ec83fe', '4ada6bd5-3250-4842-a0ea-ed5aace2268a', '3a84cfcc-bac3-4361-8499-a3e422e2bc93'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:30:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6d41a09b-d999-4788-9c23-2bb987128539 tempest-ServersNegativeTestJSON-534171205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6d41a09b-d999-4788-9c23-2bb987128539 tempest-ServersNegativeTestJSON-534171205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6d41a09b-d999-4788-9c23-2bb987128539 tempest-ServersNegativeTestJSON-534171205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6d41a09b-d999-4788-9c23-2bb987128539 tempest-ServersNegativeTestJSON-534171205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6d41a09b-d999-4788-9c23-2bb987128539 tempest-ServersNegativeTestJSON-534171205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6d41a09b-d999-4788-9c23-2bb987128539 tempest-ServersNegativeTestJSON-534171205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:35 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:30:35 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:35 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6d41a09b-d999-4788-9c23-2bb987128539 tempest-ServersNegativeTestJSON-534171205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.329s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:35 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-6d41a09b-d999-4788-9c23-2bb987128539 tempest-ServersNegativeTestJSON-534171205 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:30:35 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-6d41a09b-d999-4788-9c23-2bb987128539 tempest-ServersNegativeTestJSON-534171205 None] Deleted volume successfully. Nov 03 07:30:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6d41a09b-d999-4788-9c23-2bb987128539 tempest-ServersNegativeTestJSON-534171205 None] Lock "cinder-eab6b1c0-faf6-48a0-b35a-86cc8f5d8cdf-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:45 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:UPDATE=107,cinder:SELECT=93,cinder:INSERT=27,cinder:DELETE=3 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:30:45 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:UPDATE=99,cinder:DELETE=12,cinder:SELECT=71,cinder:INSERT=33 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:30:47 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:30:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Flow 'volume_create_manager' (f3f6ddeb-7d2b-4223-9a6c-e6faea8d35d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92057f51-1eb5-423d-ab9d-b4f68b8abf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92057f51-1eb5-423d-ab9d-b4f68b8abf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2036220353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f19eba-e29a-42fe-b62d-803c548711a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a2029c212bf4c6290a934c9a42473f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:47Z,use_quota=True,user_id='33c540f6784f47d68af0f733670f0d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1883c4e-813a-4bde-bf3f-49ce13e8db75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1883c4e-813a-4bde-bf3f-49ce13e8db75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd74a90-24d3-4e69-9729-0198ddda4db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd74a90-24d3-4e69-9729-0198ddda4db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96f19eba-e29a-42fe-b62d-803c548711a5', 'volume_name': 'volume-96f19eba-e29a-42fe-b62d-803c548711a5', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff0f2c68-2d73-49f5-9050-0865874154a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff0f2c68-2d73-49f5-9050-0865874154a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803a430a-43a4-4407-afac-c6d6d93ed16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:47 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Volume 96f19eba-e29a-42fe-b62d-803c548711a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96f19eba-e29a-42fe-b62d-803c548711a5', 'volume_size': 1} Nov 03 07:30:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2036220353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f19eba-e29a-42fe-b62d-803c548711a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a2029c212bf4c6290a934c9a42473f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:47Z,use_quota=True,user_id='33c540f6784f47d68af0f733670f0d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:30:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Creating volume 96f19eba-e29a-42fe-b62d-803c548711a5 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:30:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:30:47 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:30:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:47 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5 1073741824 Nov 03 07:30:47 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:48 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5 1073741824" returned: 0 in 0.711s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:48 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5 Nov 03 07:30:48 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:48 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5" returned: 0 in 0.384s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:30:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803a430a-43a4-4407-afac-c6d6d93ed16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96f19eba-e29a-42fe-b62d-803c548711a5', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4562d16b-17cf-428f-a2f7-bfe03fb65d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:48 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Volume volume-96f19eba-e29a-42fe-b62d-803c548711a5 (96f19eba-e29a-42fe-b62d-803c548711a5): created successfully Nov 03 07:30:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4562d16b-17cf-428f-a2f7-bfe03fb65d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Flow 'volume_create_manager' (f3f6ddeb-7d2b-4223-9a6c-e6faea8d35d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:48 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-f1ced45a-3f26-4654-a435-94c61984fd7a tempest-SnapshotsActionsTest-625008050 None] Created volume successfully. Nov 03 07:30:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:30:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:49 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:30:49 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:49 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.542s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:30:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:30:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 28 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:30:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:30:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c208f156-38c3-4d96-bd21-88af01feb70b tempest-SnapshotsActionsTest-625008050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c208f156-38c3-4d96-bd21-88af01feb70b tempest-SnapshotsActionsTest-625008050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-c208f156-38c3-4d96-bd21-88af01feb70b tempest-SnapshotsActionsTest-625008050 None] Creating offline snapshot 77fca04d-b16c-4e7e-a9d0-a513289d3078 of volume 96f19eba-e29a-42fe-b62d-803c548711a5 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:30:49 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa0d71b-1cb5-43ce-8dec-c77bba88196a]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c208f156-38c3-4d96-bd21-88af01feb70b tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:49 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5 Nov 03 07:30:49 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:50 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:30:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Flow 'volume_create_manager' (1aad0d95-7fe2-421e-99b6-4c68e89170ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e22f48-42a1-4859-8b8b-48bec2f8f0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e22f48-42a1-4859-8b8b-48bec2f8f0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1849403519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f03e80-e58f-4517-8e18-b15f46d370ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef528b9df2274d4096e2f40b55543323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:50Z,use_quota=True,user_id='e15721895a724e67be53f59d2b84d68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a1f952-ff3d-4148-83dc-4e7450e6efd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a1f952-ff3d-4148-83dc-4e7450e6efd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29db6c0-7315-4b66-91bc-646af45c5797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29db6c0-7315-4b66-91bc-646af45c5797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40f03e80-e58f-4517-8e18-b15f46d370ea', 'volume_name': 'volume-40f03e80-e58f-4517-8e18-b15f46d370ea', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316fa99e-cfd3-4ae2-b7b9-5be07798e98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316fa99e-cfd3-4ae2-b7b9-5be07798e98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d4197b-74f7-46ed-9f54-33528d3b4c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:50 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Volume 40f03e80-e58f-4517-8e18-b15f46d370ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40f03e80-e58f-4517-8e18-b15f46d370ea', 'volume_size': 1} Nov 03 07:30:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:50 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c208f156-38c3-4d96-bd21-88af01feb70b tempest-SnapshotsActionsTest-625008050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5" returned: 0 in 0.483s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c208f156-38c3-4d96-bd21-88af01feb70b tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:50 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 1G Nov 03 07:30:50 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:50 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c208f156-38c3-4d96-bd21-88af01feb70b tempest-SnapshotsActionsTest-625008050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 1G" returned: 0 in 0.508s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c208f156-38c3-4d96-bd21-88af01feb70b tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f19eba-e29a-42fe-b62d-803c548711a5 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:50 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f19eba-e29a-42fe-b62d-803c548711a5 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 Nov 03 07:30:50 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:51 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c208f156-38c3-4d96-bd21-88af01feb70b tempest-SnapshotsActionsTest-625008050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f19eba-e29a-42fe-b62d-803c548711a5 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078" returned: 0 in 0.421s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:51 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-c208f156-38c3-4d96-bd21-88af01feb70b tempest-SnapshotsActionsTest-625008050 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 is being set with open permissions: ugo+rw Nov 03 07:30:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c208f156-38c3-4d96-bd21-88af01feb70b tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:51 devstack sudo[96005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 Nov 03 07:30:51 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:51 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:30:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Flow 'volume_create_manager' (1b0f9174-4b35-4972-81e6-783cae09dfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d0e205-7151-49f3-af0e-64cf2fc1bf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d0e205-7151-49f3-af0e-64cf2fc1bf75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1093895113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed80c8b2-d116-46bb-ad1a-f11866aa13de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d9c6ad92dc4643b180454c71b66f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:51Z,use_quota=True,user_id='f7e5900c8e6441d9a0151903328beea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6cf4c9-7bf2-41eb-a696-d821758b2ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6cf4c9-7bf2-41eb-a696-d821758b2ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6a9ebd-3d38-453e-92fe-a0a7ac215a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6a9ebd-3d38-453e-92fe-a0a7ac215a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed80c8b2-d116-46bb-ad1a-f11866aa13de', 'volume_name': 'volume-ed80c8b2-d116-46bb-ad1a-f11866aa13de', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b134f2c1-e68c-4ff5-855a-a65e309c7ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b134f2c1-e68c-4ff5-855a-a65e309c7ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76cdccec-ab79-40d0-943a-608cfbcb0386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:51 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Volume ed80c8b2-d116-46bb-ad1a-f11866aa13de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed80c8b2-d116-46bb-ad1a-f11866aa13de', 'volume_size': 1} Nov 03 07:30:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:51 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c208f156-38c3-4d96-bd21-88af01feb70b tempest-SnapshotsActionsTest-625008050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078" returned: 0 in 0.328s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c208f156-38c3-4d96-bd21-88af01feb70b tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:51 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.info Nov 03 07:30:51 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:51 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c208f156-38c3-4d96-bd21-88af01feb70b tempest-SnapshotsActionsTest-625008050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.info" returned: 0 in 0.300s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:51 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-c208f156-38c3-4d96-bd21-88af01feb70b tempest-SnapshotsActionsTest-625008050 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.info is being set with open permissions: ugo+rw Nov 03 07:30:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c208f156-38c3-4d96-bd21-88af01feb70b tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:51 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.info Nov 03 07:30:51 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:52 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c208f156-38c3-4d96-bd21-88af01feb70b tempest-SnapshotsActionsTest-625008050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.info" returned: 0 in 0.320s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c208f156-38c3-4d96-bd21-88af01feb70b tempest-SnapshotsActionsTest-625008050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.465s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.081s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1849403519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f03e80-e58f-4517-8e18-b15f46d370ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef528b9df2274d4096e2f40b55543323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:50Z,use_quota=True,user_id='e15721895a724e67be53f59d2b84d68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:30:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Creating volume 40f03e80-e58f-4517-8e18-b15f46d370ea {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:30:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:30:52 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:30:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:52 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea 1073741824 Nov 03 07:30:52 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:52 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-c208f156-38c3-4d96-bd21-88af01feb70b tempest-SnapshotsActionsTest-625008050 None] Create snapshot completed successfully Nov 03 07:30:52 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea 1073741824" returned: 0 in 0.512s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:52 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea Nov 03 07:30:52 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:53 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea" returned: 0 in 0.351s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:30:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.771s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1093895113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed80c8b2-d116-46bb-ad1a-f11866aa13de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d9c6ad92dc4643b180454c71b66f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:51Z,use_quota=True,user_id='f7e5900c8e6441d9a0151903328beea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:30:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Creating volume ed80c8b2-d116-46bb-ad1a-f11866aa13de {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:30:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:30:53 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:30:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed80c8b2-d116-46bb-ad1a-f11866aa13de 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d4197b-74f7-46ed-9f54-33528d3b4c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40f03e80-e58f-4517-8e18-b15f46d370ea', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ab7cd1-38e2-4d7b-a54f-fe3ac934fe57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:53 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed80c8b2-d116-46bb-ad1a-f11866aa13de 1073741824 Nov 03 07:30:53 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:53 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Volume volume-40f03e80-e58f-4517-8e18-b15f46d370ea (40f03e80-e58f-4517-8e18-b15f46d370ea): created successfully Nov 03 07:30:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ab7cd1-38e2-4d7b-a54f-fe3ac934fe57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Flow 'volume_create_manager' (1aad0d95-7fe2-421e-99b6-4c68e89170ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:53 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a2d9ba6b-5e3c-47fa-bde6-a2baef24374c tempest-VolumesSnapshotTestJSON-1430329829 None] Created volume successfully. Nov 03 07:30:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-880306e1-e9a3-491e-9cce-6f8bc4c150c5 tempest-SnapshotsActionsTest-625008050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:53 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed80c8b2-d116-46bb-ad1a-f11866aa13de 1073741824" returned: 0 in 0.686s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed80c8b2-d116-46bb-ad1a-f11866aa13de {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:53 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed80c8b2-d116-46bb-ad1a-f11866aa13de Nov 03 07:30:53 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:54 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed80c8b2-d116-46bb-ad1a-f11866aa13de" returned: 0 in 0.281s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:30:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-880306e1-e9a3-491e-9cce-6f8bc4c150c5 tempest-SnapshotsActionsTest-625008050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.422s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:54 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76cdccec-ab79-40d0-943a-608cfbcb0386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed80c8b2-d116-46bb-ad1a-f11866aa13de', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:54 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d834e01-02a7-4913-a725-792c13345095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-880306e1-e9a3-491e-9cce-6f8bc4c150c5 tempest-SnapshotsActionsTest-625008050 None] Creating offline snapshot d5bf5bee-e0d3-435d-bc29-4d5951ea0da0 of volume 96f19eba-e29a-42fe-b62d-803c548711a5 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:30:54 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[06194fab-80b4-41f8-88b2-dcda16ce8c51]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-880306e1-e9a3-491e-9cce-6f8bc4c150c5 tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:54 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Volume volume-ed80c8b2-d116-46bb-ad1a-f11866aa13de (ed80c8b2-d116-46bb-ad1a-f11866aa13de): created successfully Nov 03 07:30:54 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d834e01-02a7-4913-a725-792c13345095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:54 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Flow 'volume_create_manager' (1b0f9174-4b35-4972-81e6-783cae09dfe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:54 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-3e1b6bb3-5a2c-47f1-a938-8aba1f511054 tempest-AttachVolumeTestJSON-654495122 None] Created volume successfully. Nov 03 07:30:54 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 Nov 03 07:30:54 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-123dcccb-7265-4fae-8807-2d8d6ccd048d tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:54 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-880306e1-e9a3-491e-9cce-6f8bc4c150c5 tempest-SnapshotsActionsTest-625008050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078" returned: 0 in 0.598s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-880306e1-e9a3-491e-9cce-6f8bc4c150c5 tempest-SnapshotsActionsTest-625008050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96f19eba-e29a-42fe-b62d-803c548711a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:30:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-880306e1-e9a3-491e-9cce-6f8bc4c150c5 tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.d5bf5bee-e0d3-435d-bc29-4d5951ea0da0 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:55 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.d5bf5bee-e0d3-435d-bc29-4d5951ea0da0 1G Nov 03 07:30:55 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:55 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-880306e1-e9a3-491e-9cce-6f8bc4c150c5 tempest-SnapshotsActionsTest-625008050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.d5bf5bee-e0d3-435d-bc29-4d5951ea0da0 1G" returned: 0 in 0.508s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-880306e1-e9a3-491e-9cce-6f8bc4c150c5 tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.d5bf5bee-e0d3-435d-bc29-4d5951ea0da0 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:55 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.d5bf5bee-e0d3-435d-bc29-4d5951ea0da0 Nov 03 07:30:55 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:56 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-880306e1-e9a3-491e-9cce-6f8bc4c150c5 tempest-SnapshotsActionsTest-625008050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.d5bf5bee-e0d3-435d-bc29-4d5951ea0da0" returned: 0 in 0.522s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:56 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-880306e1-e9a3-491e-9cce-6f8bc4c150c5 tempest-SnapshotsActionsTest-625008050 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.d5bf5bee-e0d3-435d-bc29-4d5951ea0da0 is being set with open permissions: ugo+rw Nov 03 07:30:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-880306e1-e9a3-491e-9cce-6f8bc4c150c5 tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.d5bf5bee-e0d3-435d-bc29-4d5951ea0da0 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:56 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.d5bf5bee-e0d3-435d-bc29-4d5951ea0da0 Nov 03 07:30:56 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:56 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-880306e1-e9a3-491e-9cce-6f8bc4c150c5 tempest-SnapshotsActionsTest-625008050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.d5bf5bee-e0d3-435d-bc29-4d5951ea0da0" returned: 0 in 0.477s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-880306e1-e9a3-491e-9cce-6f8bc4c150c5 tempest-SnapshotsActionsTest-625008050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.357s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-123dcccb-7265-4fae-8807-2d8d6ccd048d tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.597s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-123dcccb-7265-4fae-8807-2d8d6ccd048d tempest-VolumesSnapshotTestJSON-1430329829 None] Creating offline snapshot 878d77a5-5410-4fe1-b2e3-0dd483abfe25 of volume 40f03e80-e58f-4517-8e18-b15f46d370ea {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:30:56 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-880306e1-e9a3-491e-9cce-6f8bc4c150c5 tempest-SnapshotsActionsTest-625008050 None] Create snapshot completed successfully Nov 03 07:30:56 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ce24d2-c221-4875-8de4-dff7472dbdb1]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-123dcccb-7265-4fae-8807-2d8d6ccd048d tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:56 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea Nov 03 07:30:56 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-ca4d6029-61df-4470-93b3-3ad955a1064e req-04497c52-305b-40ff-9aaf-1bbcb705293f tempest-AttachVolumeTestJSON-654495122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2da94801-99fb-4370-999a-569760049060 tempest-SnapshotsActionsTest-1212491325 None] Acquiring lock "cinder-d5bf5bee-e0d3-435d-bc29-4d5951ea0da0-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2da94801-99fb-4370-999a-569760049060 tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-d5bf5bee-e0d3-435d-bc29-4d5951ea0da0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2da94801-99fb-4370-999a-569760049060 tempest-SnapshotsActionsTest-1212491325 None] Acquiring lock "cinder-quobyte-96f19eba-e29a-42fe-b62d-803c548711a5" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:57 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-123dcccb-7265-4fae-8807-2d8d6ccd048d tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea" returned: 0 in 0.586s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-123dcccb-7265-4fae-8807-2d8d6ccd048d tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.878d77a5-5410-4fe1-b2e3-0dd483abfe25 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2da94801-99fb-4370-999a-569760049060 tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-quobyte-96f19eba-e29a-42fe-b62d-803c548711a5" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2da94801-99fb-4370-999a-569760049060 tempest-SnapshotsActionsTest-1212491325 None] Acquiring lock "cinder-quobyte-d5bf5bee-e0d3-435d-bc29-4d5951ea0da0" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:57 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.878d77a5-5410-4fe1-b2e3-0dd483abfe25 1G Nov 03 07:30:57 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2da94801-99fb-4370-999a-569760049060 tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-quobyte-d5bf5bee-e0d3-435d-bc29-4d5951ea0da0" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:57 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-2da94801-99fb-4370-999a-569760049060 tempest-SnapshotsActionsTest-1212491325 None] Deleting offline snapshot d5bf5bee-e0d3-435d-bc29-4d5951ea0da0 of volume 96f19eba-e29a-42fe-b62d-803c548711a5 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:30:57 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-2da94801-99fb-4370-999a-569760049060 tempest-SnapshotsActionsTest-1212491325 None] snapshot_file for this snap is: volume-96f19eba-e29a-42fe-b62d-803c548711a5.d5bf5bee-e0d3-435d-bc29-4d5951ea0da0 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:30:57 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[6988e8ff-4dc5-45fa-886f-34deb5709221]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2da94801-99fb-4370-999a-569760049060 tempest-SnapshotsActionsTest-1212491325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.d5bf5bee-e0d3-435d-bc29-4d5951ea0da0 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:57 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.d5bf5bee-e0d3-435d-bc29-4d5951ea0da0 Nov 03 07:30:57 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:57 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-123dcccb-7265-4fae-8807-2d8d6ccd048d tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.878d77a5-5410-4fe1-b2e3-0dd483abfe25 1G" returned: 0 in 0.649s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-123dcccb-7265-4fae-8807-2d8d6ccd048d tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40f03e80-e58f-4517-8e18-b15f46d370ea -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.878d77a5-5410-4fe1-b2e3-0dd483abfe25 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:57 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2da94801-99fb-4370-999a-569760049060 tempest-SnapshotsActionsTest-1212491325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.d5bf5bee-e0d3-435d-bc29-4d5951ea0da0" returned: 0 in 0.558s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:57 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-2da94801-99fb-4370-999a-569760049060 tempest-SnapshotsActionsTest-1212491325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96f19eba-e29a-42fe-b62d-803c548711a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:30:57 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40f03e80-e58f-4517-8e18-b15f46d370ea -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.878d77a5-5410-4fe1-b2e3-0dd483abfe25 Nov 03 07:30:57 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:57 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d8ff1c-0f2a-496e-bf37-91f75c4b64f2]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2da94801-99fb-4370-999a-569760049060 tempest-SnapshotsActionsTest-1212491325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:58 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 Nov 03 07:30:58 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:58 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-123dcccb-7265-4fae-8807-2d8d6ccd048d tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40f03e80-e58f-4517-8e18-b15f46d370ea -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.878d77a5-5410-4fe1-b2e3-0dd483abfe25" returned: 0 in 0.480s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:58 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-123dcccb-7265-4fae-8807-2d8d6ccd048d tempest-VolumesSnapshotTestJSON-1430329829 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.878d77a5-5410-4fe1-b2e3-0dd483abfe25 is being set with open permissions: ugo+rw Nov 03 07:30:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-123dcccb-7265-4fae-8807-2d8d6ccd048d tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.878d77a5-5410-4fe1-b2e3-0dd483abfe25 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:58 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.878d77a5-5410-4fe1-b2e3-0dd483abfe25 Nov 03 07:30:58 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:58 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2da94801-99fb-4370-999a-569760049060 tempest-SnapshotsActionsTest-1212491325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078" returned: 0 in 0.546s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-2da94801-99fb-4370-999a-569760049060 tempest-SnapshotsActionsTest-1212491325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96f19eba-e29a-42fe-b62d-803c548711a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:30:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2da94801-99fb-4370-999a-569760049060 tempest-SnapshotsActionsTest-1212491325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.d5bf5bee-e0d3-435d-bc29-4d5951ea0da0 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:58 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.d5bf5bee-e0d3-435d-bc29-4d5951ea0da0 Nov 03 07:30:58 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:58 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-123dcccb-7265-4fae-8807-2d8d6ccd048d tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.878d77a5-5410-4fe1-b2e3-0dd483abfe25" returned: 0 in 0.369s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-123dcccb-7265-4fae-8807-2d8d6ccd048d tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:58 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.info Nov 03 07:30:58 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:59 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-123dcccb-7265-4fae-8807-2d8d6ccd048d tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.info" returned: 0 in 0.314s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:59 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-123dcccb-7265-4fae-8807-2d8d6ccd048d tempest-VolumesSnapshotTestJSON-1430329829 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.info is being set with open permissions: ugo+rw Nov 03 07:30:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-123dcccb-7265-4fae-8807-2d8d6ccd048d tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:59 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.info Nov 03 07:30:59 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:59 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2da94801-99fb-4370-999a-569760049060 tempest-SnapshotsActionsTest-1212491325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.d5bf5bee-e0d3-435d-bc29-4d5951ea0da0" returned: 0 in 0.761s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2da94801-99fb-4370-999a-569760049060 tempest-SnapshotsActionsTest-1212491325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.d5bf5bee-e0d3-435d-bc29-4d5951ea0da0 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:59 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.d5bf5bee-e0d3-435d-bc29-4d5951ea0da0 Nov 03 07:30:59 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:59 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-123dcccb-7265-4fae-8807-2d8d6ccd048d tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.info" returned: 0 in 0.434s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-123dcccb-7265-4fae-8807-2d8d6ccd048d tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-ca4d6029-61df-4470-93b3-3ad955a1064e req-04497c52-305b-40ff-9aaf-1bbcb705293f tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.782s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-ca4d6029-61df-4470-93b3-3ad955a1064e req-04497c52-305b-40ff-9aaf-1bbcb705293f tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:59 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2da94801-99fb-4370-999a-569760049060 tempest-SnapshotsActionsTest-1212491325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.d5bf5bee-e0d3-435d-bc29-4d5951ea0da0" returned: 0 in 0.357s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2da94801-99fb-4370-999a-569760049060 tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-quobyte-d5bf5bee-e0d3-435d-bc29-4d5951ea0da0" released by "_delete_snapshot" :: held 2.400s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2da94801-99fb-4370-999a-569760049060 tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-quobyte-96f19eba-e29a-42fe-b62d-803c548711a5" released by "delete_snapshot" :: held 2.447s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-ca4d6029-61df-4470-93b3-3ad955a1064e req-04497c52-305b-40ff-9aaf-1bbcb705293f tempest-AttachVolumeTestJSON-654495122 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14', 'name': 'volume-ed80c8b2-d116-46bb-ad1a-f11866aa13de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49dfcd4a-e53d-47ea-a591-acac1e534300', 'enforce_multipath': True} {{(pid=87016) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:30:59 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-123dcccb-7265-4fae-8807-2d8d6ccd048d tempest-VolumesSnapshotTestJSON-1430329829 None] Create snapshot completed successfully Nov 03 07:30:59 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-ca4d6029-61df-4470-93b3-3ad955a1064e req-04497c52-305b-40ff-9aaf-1bbcb705293f tempest-AttachVolumeTestJSON-654495122 None] attachment_update completed successfully. Nov 03 07:30:59 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-2da94801-99fb-4370-999a-569760049060 tempest-SnapshotsActionsTest-1212491325 None] Created reservations ['39b588c4-8a0d-4cf9-b765-4a1bd3a5f6b7', '9c21939d-9709-45da-8c81-5e72f188dc22', '59f9acea-b373-486d-ad99-acaf4600c8af', 'd034eb37-8633-40de-90e7-25ee5859621a'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:30:59 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-2da94801-99fb-4370-999a-569760049060 tempest-SnapshotsActionsTest-1212491325 None] Delete snapshot completed successfully. Nov 03 07:30:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2da94801-99fb-4370-999a-569760049060 tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-d5bf5bee-e0d3-435d-bc29-4d5951ea0da0-delete_snapshot" released by "delete_snapshot" :: held 2.775s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3b637fba-593f-459a-96e5-1ecc3a670a30 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "cinder-878d77a5-5410-4fe1-b2e3-0dd483abfe25-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3b637fba-593f-459a-96e5-1ecc3a670a30 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-878d77a5-5410-4fe1-b2e3-0dd483abfe25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3b637fba-593f-459a-96e5-1ecc3a670a30 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "cinder-quobyte-40f03e80-e58f-4517-8e18-b15f46d370ea" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3b637fba-593f-459a-96e5-1ecc3a670a30 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-40f03e80-e58f-4517-8e18-b15f46d370ea" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3b637fba-593f-459a-96e5-1ecc3a670a30 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "cinder-quobyte-878d77a5-5410-4fe1-b2e3-0dd483abfe25" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3b637fba-593f-459a-96e5-1ecc3a670a30 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-878d77a5-5410-4fe1-b2e3-0dd483abfe25" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-3b637fba-593f-459a-96e5-1ecc3a670a30 tempest-VolumesSnapshotTestJSON-1430329829 None] Deleting offline snapshot 878d77a5-5410-4fe1-b2e3-0dd483abfe25 of volume 40f03e80-e58f-4517-8e18-b15f46d370ea {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:31:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-3b637fba-593f-459a-96e5-1ecc3a670a30 tempest-VolumesSnapshotTestJSON-1430329829 None] snapshot_file for this snap is: volume-40f03e80-e58f-4517-8e18-b15f46d370ea.878d77a5-5410-4fe1-b2e3-0dd483abfe25 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:31:00 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caa0c35-4bfe-432b-9c87-81c913dbbbfd]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3b637fba-593f-459a-96e5-1ecc3a670a30 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.878d77a5-5410-4fe1-b2e3-0dd483abfe25 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:00 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.878d77a5-5410-4fe1-b2e3-0dd483abfe25 Nov 03 07:31:00 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d827b335-9937-48a3-b309-07c4c3ce8d47 tempest-SnapshotsActionsTest-625008050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d827b335-9937-48a3-b309-07c4c3ce8d47 tempest-SnapshotsActionsTest-625008050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:01 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-d827b335-9937-48a3-b309-07c4c3ce8d47 tempest-SnapshotsActionsTest-625008050 None] Creating offline snapshot 2a752bb1-1c00-4fb9-b129-90eae41b69f6 of volume 96f19eba-e29a-42fe-b62d-803c548711a5 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:31:01 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[13902cf8-6311-445e-aad0-1b84d7d1b2b4]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d827b335-9937-48a3-b309-07c4c3ce8d47 tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:01 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3b637fba-593f-459a-96e5-1ecc3a670a30 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.878d77a5-5410-4fe1-b2e3-0dd483abfe25" returned: 0 in 0.600s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:01 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-3b637fba-593f-459a-96e5-1ecc3a670a30 tempest-VolumesSnapshotTestJSON-1430329829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40f03e80-e58f-4517-8e18-b15f46d370ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:31:01 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 Nov 03 07:31:01 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:01 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db8e0ba-f9a8-4e87-9a2c-5207e43e6de6]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3b637fba-593f-459a-96e5-1ecc3a670a30 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:01 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea Nov 03 07:31:01 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:01 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d827b335-9937-48a3-b309-07c4c3ce8d47 tempest-SnapshotsActionsTest-625008050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078" returned: 0 in 0.672s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:01 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-d827b335-9937-48a3-b309-07c4c3ce8d47 tempest-SnapshotsActionsTest-625008050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96f19eba-e29a-42fe-b62d-803c548711a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:31:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d827b335-9937-48a3-b309-07c4c3ce8d47 tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.2a752bb1-1c00-4fb9-b129-90eae41b69f6 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:01 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.2a752bb1-1c00-4fb9-b129-90eae41b69f6 1G Nov 03 07:31:01 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:02 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3b637fba-593f-459a-96e5-1ecc3a670a30 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea" returned: 0 in 0.684s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3b637fba-593f-459a-96e5-1ecc3a670a30 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.878d77a5-5410-4fe1-b2e3-0dd483abfe25 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:02 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.878d77a5-5410-4fe1-b2e3-0dd483abfe25 Nov 03 07:31:02 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:02 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d827b335-9937-48a3-b309-07c4c3ce8d47 tempest-SnapshotsActionsTest-625008050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.2a752bb1-1c00-4fb9-b129-90eae41b69f6 1G" returned: 0 in 0.785s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d827b335-9937-48a3-b309-07c4c3ce8d47 tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.2a752bb1-1c00-4fb9-b129-90eae41b69f6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:02 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.2a752bb1-1c00-4fb9-b129-90eae41b69f6 Nov 03 07:31:02 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:02 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3b637fba-593f-459a-96e5-1ecc3a670a30 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.878d77a5-5410-4fe1-b2e3-0dd483abfe25" returned: 0 in 0.583s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3b637fba-593f-459a-96e5-1ecc3a670a30 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.878d77a5-5410-4fe1-b2e3-0dd483abfe25 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:02 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.878d77a5-5410-4fe1-b2e3-0dd483abfe25 Nov 03 07:31:02 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:03 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:03 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3b637fba-593f-459a-96e5-1ecc3a670a30 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea.878d77a5-5410-4fe1-b2e3-0dd483abfe25" returned: 0 in 0.430s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d827b335-9937-48a3-b309-07c4c3ce8d47 tempest-SnapshotsActionsTest-625008050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.2a752bb1-1c00-4fb9-b129-90eae41b69f6" returned: 0 in 0.496s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:03 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-d827b335-9937-48a3-b309-07c4c3ce8d47 tempest-SnapshotsActionsTest-625008050 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.2a752bb1-1c00-4fb9-b129-90eae41b69f6 is being set with open permissions: ugo+rw Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d827b335-9937-48a3-b309-07c4c3ce8d47 tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.2a752bb1-1c00-4fb9-b129-90eae41b69f6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:03 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.2a752bb1-1c00-4fb9-b129-90eae41b69f6 Nov 03 07:31:03 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Flow 'volume_create_manager' (a652d048-4988-47ab-8f46-0703a95536a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c52e8a-5692-4402-9a2b-32b0757737d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3b637fba-593f-459a-96e5-1ecc3a670a30 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-878d77a5-5410-4fe1-b2e3-0dd483abfe25" released by "_delete_snapshot" :: held 2.573s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3b637fba-593f-459a-96e5-1ecc3a670a30 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-40f03e80-e58f-4517-8e18-b15f46d370ea" released by "delete_snapshot" :: held 2.611s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c52e8a-5692-4402-9a2b-32b0757737d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-18644175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c962ca-269d-49c5-9895-16db9d68cd2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d9c6ad92dc4643b180454c71b66f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:03Z,use_quota=True,user_id='f7e5900c8e6441d9a0151903328beea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dede1a7b-4a75-47ac-8f8a-cdebb017ccdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dede1a7b-4a75-47ac-8f8a-cdebb017ccdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6296cf-a575-4d53-b8a4-c1d9feb13334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6296cf-a575-4d53-b8a4-c1d9feb13334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74c962ca-269d-49c5-9895-16db9d68cd2e', 'volume_name': 'volume-74c962ca-269d-49c5-9895-16db9d68cd2e', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9dbfe5-85af-4972-bf09-8ed144615284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9dbfe5-85af-4972-bf09-8ed144615284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c14f4f0-371f-4699-8d60-992cf84d10e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:03 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Volume 74c962ca-269d-49c5-9895-16db9d68cd2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74c962ca-269d-49c5-9895-16db9d68cd2e', 'volume_size': 1} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-3b637fba-593f-459a-96e5-1ecc3a670a30 tempest-VolumesSnapshotTestJSON-1430329829 None] Created reservations ['fea765c3-ebb9-494a-913b-0ab12f478106', 'b2b3695c-0d27-482f-8e9a-e270fd026a44', '13cc7e72-90fa-42b5-9b3b-5063586e54a2', '9761197b-bd0d-4136-9057-a3a7613b90e8'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:31:03 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-3b637fba-593f-459a-96e5-1ecc3a670a30 tempest-VolumesSnapshotTestJSON-1430329829 None] Delete snapshot completed successfully. Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3b637fba-593f-459a-96e5-1ecc3a670a30 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-878d77a5-5410-4fe1-b2e3-0dd483abfe25-delete_snapshot" released by "delete_snapshot" :: held 2.898s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:03 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d827b335-9937-48a3-b309-07c4c3ce8d47 tempest-SnapshotsActionsTest-625008050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.2a752bb1-1c00-4fb9-b129-90eae41b69f6" returned: 0 in 0.367s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d827b335-9937-48a3-b309-07c4c3ce8d47 tempest-SnapshotsActionsTest-625008050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.505s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.232s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-18644175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c962ca-269d-49c5-9895-16db9d68cd2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d9c6ad92dc4643b180454c71b66f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:03Z,use_quota=True,user_id='f7e5900c8e6441d9a0151903328beea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Creating volume 74c962ca-269d-49c5-9895-16db9d68cd2e {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:31:03 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:31:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-74c962ca-269d-49c5-9895-16db9d68cd2e 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:03 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-74c962ca-269d-49c5-9895-16db9d68cd2e 1073741824 Nov 03 07:31:03 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:03 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-d827b335-9937-48a3-b309-07c4c3ce8d47 tempest-SnapshotsActionsTest-625008050 None] Create snapshot completed successfully Nov 03 07:31:04 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-74c962ca-269d-49c5-9895-16db9d68cd2e 1073741824" returned: 0 in 0.657s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-74c962ca-269d-49c5-9895-16db9d68cd2e {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:04 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-74c962ca-269d-49c5-9895-16db9d68cd2e Nov 03 07:31:04 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f9c748ea-73ac-412d-ade7-202c394e8505 tempest-SnapshotsActionsTest-1212491325 None] Acquiring lock "cinder-2a752bb1-1c00-4fb9-b129-90eae41b69f6-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f9c748ea-73ac-412d-ade7-202c394e8505 tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-2a752bb1-1c00-4fb9-b129-90eae41b69f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f9c748ea-73ac-412d-ade7-202c394e8505 tempest-SnapshotsActionsTest-1212491325 None] Acquiring lock "cinder-quobyte-96f19eba-e29a-42fe-b62d-803c548711a5" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f9c748ea-73ac-412d-ade7-202c394e8505 tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-quobyte-96f19eba-e29a-42fe-b62d-803c548711a5" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f9c748ea-73ac-412d-ade7-202c394e8505 tempest-SnapshotsActionsTest-1212491325 None] Acquiring lock "cinder-quobyte-2a752bb1-1c00-4fb9-b129-90eae41b69f6" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f9c748ea-73ac-412d-ade7-202c394e8505 tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-quobyte-2a752bb1-1c00-4fb9-b129-90eae41b69f6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-f9c748ea-73ac-412d-ade7-202c394e8505 tempest-SnapshotsActionsTest-1212491325 None] Deleting offline snapshot 2a752bb1-1c00-4fb9-b129-90eae41b69f6 of volume 96f19eba-e29a-42fe-b62d-803c548711a5 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-f9c748ea-73ac-412d-ade7-202c394e8505 tempest-SnapshotsActionsTest-1212491325 None] snapshot_file for this snap is: volume-96f19eba-e29a-42fe-b62d-803c548711a5.2a752bb1-1c00-4fb9-b129-90eae41b69f6 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f1190a-9926-4888-8d37-a702ac9a58e2]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f9c748ea-73ac-412d-ade7-202c394e8505 tempest-SnapshotsActionsTest-1212491325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.2a752bb1-1c00-4fb9-b129-90eae41b69f6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:04 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:31:04 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.2a752bb1-1c00-4fb9-b129-90eae41b69f6 Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Flow 'volume_create_manager' (2bdc0c14-55fb-4de4-a27a-9b45cde4207f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:04 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c308fa-0704-4a2b-b038-a6497e41dfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-74c962ca-269d-49c5-9895-16db9d68cd2e" returned: 0 in 0.490s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c308fa-0704-4a2b-b038-a6497e41dfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-457245078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c14e388-f124-497a-8bb7-73fab40c9421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef528b9df2274d4096e2f40b55543323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:05Z,use_quota=True,user_id='e15721895a724e67be53f59d2b84d68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959e6fb1-ed08-427e-bbc1-207d5647d860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959e6fb1-ed08-427e-bbc1-207d5647d860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc37313-980b-4f9a-8fa0-2021d4e304b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc37313-980b-4f9a-8fa0-2021d4e304b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c14e388-f124-497a-8bb7-73fab40c9421', 'volume_name': 'volume-4c14e388-f124-497a-8bb7-73fab40c9421', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a32d2487-0036-4be0-bd65-d2097532e913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a32d2487-0036-4be0-bd65-d2097532e913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a6e47c-162f-4f40-b16e-2fdbc677fd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:04 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Volume 4c14e388-f124-497a-8bb7-73fab40c9421: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c14e388-f124-497a-8bb7-73fab40c9421', 'volume_size': 1} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-457245078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c14e388-f124-497a-8bb7-73fab40c9421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef528b9df2274d4096e2f40b55543323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:05Z,use_quota=True,user_id='e15721895a724e67be53f59d2b84d68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Creating volume 4c14e388-f124-497a-8bb7-73fab40c9421 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:31:04 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c14f4f0-371f-4699-8d60-992cf84d10e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74c962ca-269d-49c5-9895-16db9d68cd2e', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a2e21d-c23b-43f2-be5c-301d1e2f58f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:04 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421 1073741824 Nov 03 07:31:04 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:04 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Volume volume-74c962ca-269d-49c5-9895-16db9d68cd2e (74c962ca-269d-49c5-9895-16db9d68cd2e): created successfully Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a2e21d-c23b-43f2-be5c-301d1e2f58f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Flow 'volume_create_manager' (a652d048-4988-47ab-8f46-0703a95536a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:04 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b5db90ac-9d37-4a4b-b934-48d8e6c81e5b tempest-AttachVolumeTestJSON-654495122 None] Created volume successfully. Nov 03 07:31:05 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f9c748ea-73ac-412d-ade7-202c394e8505 tempest-SnapshotsActionsTest-1212491325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.2a752bb1-1c00-4fb9-b129-90eae41b69f6" returned: 0 in 0.561s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-f9c748ea-73ac-412d-ade7-202c394e8505 tempest-SnapshotsActionsTest-1212491325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96f19eba-e29a-42fe-b62d-803c548711a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:31:05 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[d781943b-9604-47ce-9e6d-b534f0cb2f93]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f9c748ea-73ac-412d-ade7-202c394e8505 tempest-SnapshotsActionsTest-1212491325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:05 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 Nov 03 07:31:05 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:05 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421 1073741824" returned: 0 in 0.639s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:05 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421 Nov 03 07:31:05 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:05 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f9c748ea-73ac-412d-ade7-202c394e8505 tempest-SnapshotsActionsTest-1212491325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078" returned: 0 in 0.519s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-f9c748ea-73ac-412d-ade7-202c394e8505 tempest-SnapshotsActionsTest-1212491325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96f19eba-e29a-42fe-b62d-803c548711a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:31:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f9c748ea-73ac-412d-ade7-202c394e8505 tempest-SnapshotsActionsTest-1212491325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.2a752bb1-1c00-4fb9-b129-90eae41b69f6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:05 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.2a752bb1-1c00-4fb9-b129-90eae41b69f6 Nov 03 07:31:05 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:05 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421" returned: 0 in 0.318s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:31:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a6e47c-162f-4f40-b16e-2fdbc677fd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c14e388-f124-497a-8bb7-73fab40c9421', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17a6159-1609-4c63-862c-2f4f977101db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:05 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Volume volume-4c14e388-f124-497a-8bb7-73fab40c9421 (4c14e388-f124-497a-8bb7-73fab40c9421): created successfully Nov 03 07:31:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17a6159-1609-4c63-862c-2f4f977101db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Flow 'volume_create_manager' (2bdc0c14-55fb-4de4-a27a-9b45cde4207f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:05 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ee692675-ebc4-4363-a1dd-46ec8053d482 tempest-VolumesSnapshotTestJSON-1430329829 None] Created volume successfully. Nov 03 07:31:06 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f9c748ea-73ac-412d-ade7-202c394e8505 tempest-SnapshotsActionsTest-1212491325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.2a752bb1-1c00-4fb9-b129-90eae41b69f6" returned: 0 in 0.561s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f9c748ea-73ac-412d-ade7-202c394e8505 tempest-SnapshotsActionsTest-1212491325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.2a752bb1-1c00-4fb9-b129-90eae41b69f6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:06 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.2a752bb1-1c00-4fb9-b129-90eae41b69f6 Nov 03 07:31:06 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-685f9130-238f-4433-8c51-c16605a95871 req-e96177bb-765b-42fa-8f96-81b9aa7b7793 tempest-AttachVolumeTestJSON-654495122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-685f9130-238f-4433-8c51-c16605a95871 req-e96177bb-765b-42fa-8f96-81b9aa7b7793 tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-685f9130-238f-4433-8c51-c16605a95871 req-e96177bb-765b-42fa-8f96-81b9aa7b7793 tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-685f9130-238f-4433-8c51-c16605a95871 req-e96177bb-765b-42fa-8f96-81b9aa7b7793 tempest-AttachVolumeTestJSON-654495122 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14', 'name': 'volume-74c962ca-269d-49c5-9895-16db9d68cd2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd1420ff-bc76-4c2b-9e7c-bf453b831f1a', 'enforce_multipath': True} {{(pid=87016) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:31:06 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-685f9130-238f-4433-8c51-c16605a95871 req-e96177bb-765b-42fa-8f96-81b9aa7b7793 tempest-AttachVolumeTestJSON-654495122 None] attachment_update completed successfully. Nov 03 07:31:06 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f9c748ea-73ac-412d-ade7-202c394e8505 tempest-SnapshotsActionsTest-1212491325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.2a752bb1-1c00-4fb9-b129-90eae41b69f6" returned: 0 in 0.343s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:06 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f9c748ea-73ac-412d-ade7-202c394e8505 tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-quobyte-2a752bb1-1c00-4fb9-b129-90eae41b69f6" released by "_delete_snapshot" :: held 2.121s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:06 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f9c748ea-73ac-412d-ade7-202c394e8505 tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-quobyte-96f19eba-e29a-42fe-b62d-803c548711a5" released by "delete_snapshot" :: held 2.150s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:06 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-f9c748ea-73ac-412d-ade7-202c394e8505 tempest-SnapshotsActionsTest-1212491325 None] Created reservations ['c38b8b83-7a4e-472f-b319-ed866d57254a', '53fefaed-7ef9-40f8-b7db-b6db6625f2e5', '739a7051-eb3d-4919-90ad-bda19c3c69a1', '72676887-57f5-4fd8-917d-91657bba0128'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:31:06 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-f9c748ea-73ac-412d-ade7-202c394e8505 tempest-SnapshotsActionsTest-1212491325 None] Delete snapshot completed successfully. Nov 03 07:31:06 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f9c748ea-73ac-412d-ade7-202c394e8505 tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-2a752bb1-1c00-4fb9-b129-90eae41b69f6-delete_snapshot" released by "delete_snapshot" :: held 2.372s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-edb50aff-9ea1-4e0d-b40c-efa110cd156c tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-edb50aff-9ea1-4e0d-b40c-efa110cd156c tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:07 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-edb50aff-9ea1-4e0d-b40c-efa110cd156c tempest-VolumesSnapshotTestJSON-1430329829 None] Creating offline snapshot 54b4179d-d420-4cfa-a4bc-ccdac928cbcf of volume 4c14e388-f124-497a-8bb7-73fab40c9421 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:31:07 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6e2778-99d2-490e-a7c4-e84afefe1bf5]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-edb50aff-9ea1-4e0d-b40c-efa110cd156c tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:07 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421 Nov 03 07:31:07 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:07 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-edb50aff-9ea1-4e0d-b40c-efa110cd156c tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421" returned: 0 in 0.563s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-edb50aff-9ea1-4e0d-b40c-efa110cd156c tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.54b4179d-d420-4cfa-a4bc-ccdac928cbcf 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:07 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.54b4179d-d420-4cfa-a4bc-ccdac928cbcf 1G Nov 03 07:31:07 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-785208a0-6e2b-4544-a4c9-50867d5b084d tempest-SnapshotsActionsTest-625008050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:08 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-edb50aff-9ea1-4e0d-b40c-efa110cd156c tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.54b4179d-d420-4cfa-a4bc-ccdac928cbcf 1G" returned: 0 in 0.563s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-edb50aff-9ea1-4e0d-b40c-efa110cd156c tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c14e388-f124-497a-8bb7-73fab40c9421 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.54b4179d-d420-4cfa-a4bc-ccdac928cbcf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:08 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c14e388-f124-497a-8bb7-73fab40c9421 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.54b4179d-d420-4cfa-a4bc-ccdac928cbcf Nov 03 07:31:08 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:08 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-edb50aff-9ea1-4e0d-b40c-efa110cd156c tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c14e388-f124-497a-8bb7-73fab40c9421 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.54b4179d-d420-4cfa-a4bc-ccdac928cbcf" returned: 0 in 0.365s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:08 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-edb50aff-9ea1-4e0d-b40c-efa110cd156c tempest-VolumesSnapshotTestJSON-1430329829 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.54b4179d-d420-4cfa-a4bc-ccdac928cbcf is being set with open permissions: ugo+rw Nov 03 07:31:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-edb50aff-9ea1-4e0d-b40c-efa110cd156c tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.54b4179d-d420-4cfa-a4bc-ccdac928cbcf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:08 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.54b4179d-d420-4cfa-a4bc-ccdac928cbcf Nov 03 07:31:08 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:08 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-edb50aff-9ea1-4e0d-b40c-efa110cd156c tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.54b4179d-d420-4cfa-a4bc-ccdac928cbcf" returned: 0 in 0.355s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-edb50aff-9ea1-4e0d-b40c-efa110cd156c tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:09 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.info Nov 03 07:31:09 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:09 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-078c60d6-f304-426e-be92-2ac699bb78d4 req-e44b45af-6f8b-4df7-b94e-df93387e003d tempest-AttachVolumeTestJSON-654495122 None] Terminate volume connection completed successfully. Nov 03 07:31:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-078c60d6-f304-426e-be92-2ac699bb78d4 req-e44b45af-6f8b-4df7-b94e-df93387e003d tempest-AttachVolumeTestJSON-654495122 None] Deleting attachment 49dfcd4a-e53d-47ea-a591-acac1e534300. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:31:09 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-edb50aff-9ea1-4e0d-b40c-efa110cd156c tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.info" returned: 0 in 0.394s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:09 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-edb50aff-9ea1-4e0d-b40c-efa110cd156c tempest-VolumesSnapshotTestJSON-1430329829 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.info is being set with open permissions: ugo+rw Nov 03 07:31:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-edb50aff-9ea1-4e0d-b40c-efa110cd156c tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:09 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.info Nov 03 07:31:09 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:09 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-edb50aff-9ea1-4e0d-b40c-efa110cd156c tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.info" returned: 0 in 0.311s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-edb50aff-9ea1-4e0d-b40c-efa110cd156c tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.674s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-785208a0-6e2b-4544-a4c9-50867d5b084d tempest-SnapshotsActionsTest-625008050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.783s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:09 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-785208a0-6e2b-4544-a4c9-50867d5b084d tempest-SnapshotsActionsTest-625008050 None] Creating offline snapshot 17165cba-a178-4ed0-b06b-40a32765f21b of volume 96f19eba-e29a-42fe-b62d-803c548711a5 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:31:09 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-edb50aff-9ea1-4e0d-b40c-efa110cd156c tempest-VolumesSnapshotTestJSON-1430329829 None] Create snapshot completed successfully Nov 03 07:31:09 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad09921-aaa5-414c-83bf-0cdbe601cb31]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-785208a0-6e2b-4544-a4c9-50867d5b084d tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:10 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 Nov 03 07:31:10 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:10 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-785208a0-6e2b-4544-a4c9-50867d5b084d tempest-SnapshotsActionsTest-625008050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078" returned: 0 in 0.659s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-785208a0-6e2b-4544-a4c9-50867d5b084d tempest-SnapshotsActionsTest-625008050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96f19eba-e29a-42fe-b62d-803c548711a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:31:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-785208a0-6e2b-4544-a4c9-50867d5b084d tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.17165cba-a178-4ed0-b06b-40a32765f21b 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:10 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.17165cba-a178-4ed0-b06b-40a32765f21b 1G Nov 03 07:31:10 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:11 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-d73b6ae2-5146-4988-a223-4bd0f6b129dc req-11800724-2e53-4958-b5e6-cedb9ea7c0e3 tempest-AttachVolumeTestJSON-654495122 None] Terminate volume connection completed successfully. Nov 03 07:31:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-d73b6ae2-5146-4988-a223-4bd0f6b129dc req-11800724-2e53-4958-b5e6-cedb9ea7c0e3 tempest-AttachVolumeTestJSON-654495122 None] Deleting attachment cd1420ff-bc76-4c2b-9e7c-bf453b831f1a. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:31:11 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:31:11 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-785208a0-6e2b-4544-a4c9-50867d5b084d tempest-SnapshotsActionsTest-625008050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.17165cba-a178-4ed0-b06b-40a32765f21b 1G" returned: 0 in 0.864s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-785208a0-6e2b-4544-a4c9-50867d5b084d tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.17165cba-a178-4ed0-b06b-40a32765f21b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:11 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.17165cba-a178-4ed0-b06b-40a32765f21b Nov 03 07:31:11 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Flow 'volume_create_manager' (ed6fa55e-a69b-45b7-af26-3fba0cb44f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195a997d-3543-41a2-8103-4659386a7099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195a997d-3543-41a2-8103-4659386a7099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2124812524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9e44b5-5ef6-4ced-9390-aead92b5e5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef528b9df2274d4096e2f40b55543323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=54b4179d-d420-4cfa-a4bc-ccdac928cbcf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:11Z,use_quota=True,user_id='e15721895a724e67be53f59d2b84d68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b6ea985-5247-46d6-bf3c-f93c6dd2b8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b6ea985-5247-46d6-bf3c-f93c6dd2b8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef30220-1a54-4506-a07e-be88d69b494a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef30220-1a54-4506-a07e-be88d69b494a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5d9e44b5-5ef6-4ced-9390-aead92b5e5d2', 'volume_name': 'volume-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2', 'volume_size': 2, 'snapshot_id': '54b4179d-d420-4cfa-a4bc-ccdac928cbcf'}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124e97be-e019-4792-b6bb-6fc304768032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124e97be-e019-4792-b6bb-6fc304768032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf3d0adb-12f0-44cc-b3a6-8c2c0eccabef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:11 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Volume 5d9e44b5-5ef6-4ced-9390-aead92b5e5d2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2', 'volume_size': 2, 'snapshot_id': '54b4179d-d420-4cfa-a4bc-ccdac928cbcf'} Nov 03 07:31:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:11 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-785208a0-6e2b-4544-a4c9-50867d5b084d tempest-SnapshotsActionsTest-625008050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.17165cba-a178-4ed0-b06b-40a32765f21b" returned: 0 in 0.370s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:11 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-785208a0-6e2b-4544-a4c9-50867d5b084d tempest-SnapshotsActionsTest-625008050 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.17165cba-a178-4ed0-b06b-40a32765f21b is being set with open permissions: ugo+rw Nov 03 07:31:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-785208a0-6e2b-4544-a4c9-50867d5b084d tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.17165cba-a178-4ed0-b06b-40a32765f21b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:11 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.17165cba-a178-4ed0-b06b-40a32765f21b Nov 03 07:31:11 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:12 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-785208a0-6e2b-4544-a4c9-50867d5b084d tempest-SnapshotsActionsTest-625008050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.17165cba-a178-4ed0-b06b-40a32765f21b" returned: 0 in 0.309s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-785208a0-6e2b-4544-a4c9-50867d5b084d tempest-SnapshotsActionsTest-625008050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.401s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.607s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "cinder-quobyte-54b4179d-d420-4cfa-a4bc-ccdac928cbcf-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2" by "_create_volume_from_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-54b4179d-d420-4cfa-a4bc-ccdac928cbcf-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Creating volume 5d9e44b5-5ef6-4ced-9390-aead92b5e5d2 from snapshot 54b4179d-d420-4cfa-a4bc-ccdac928cbcf {{(pid=87016) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "cinder-quobyte-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2" by "_copy_volume_from_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:12 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-785208a0-6e2b-4544-a4c9-50867d5b084d tempest-SnapshotsActionsTest-625008050 None] Create snapshot completed successfully Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] snapshot: 54b4179d-d420-4cfa-a4bc-ccdac928cbcf, volume: 5d9e44b5-5ef6-4ced-9390-aead92b5e5d2, {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3316be-d54e-45bf-8055-c608a6bc45da]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.54b4179d-d420-4cfa-a4bc-ccdac928cbcf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:12 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.54b4179d-d420-4cfa-a4bc-ccdac928cbcf Nov 03 07:31:12 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:12 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.54b4179d-d420-4cfa-a4bc-ccdac928cbcf" returned: 0 in 0.559s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c14e388-f124-497a-8bb7-73fab40c9421(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[739c7676-f1ed-4f32-8e0a-6bd47dfbe733]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:13 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421 Nov 03 07:31:13 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d925f910-e733-41a0-81a0-cd3ff176232b tempest-SnapshotsActionsTest-1212491325 None] Acquiring lock "cinder-17165cba-a178-4ed0-b06b-40a32765f21b-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d925f910-e733-41a0-81a0-cd3ff176232b tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-17165cba-a178-4ed0-b06b-40a32765f21b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d925f910-e733-41a0-81a0-cd3ff176232b tempest-SnapshotsActionsTest-1212491325 None] Acquiring lock "cinder-quobyte-96f19eba-e29a-42fe-b62d-803c548711a5" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d925f910-e733-41a0-81a0-cd3ff176232b tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-quobyte-96f19eba-e29a-42fe-b62d-803c548711a5" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d925f910-e733-41a0-81a0-cd3ff176232b tempest-SnapshotsActionsTest-1212491325 None] Acquiring lock "cinder-quobyte-17165cba-a178-4ed0-b06b-40a32765f21b" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:13 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d925f910-e733-41a0-81a0-cd3ff176232b tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-quobyte-17165cba-a178-4ed0-b06b-40a32765f21b" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-d925f910-e733-41a0-81a0-cd3ff176232b tempest-SnapshotsActionsTest-1212491325 None] Deleting offline snapshot 17165cba-a178-4ed0-b06b-40a32765f21b of volume 96f19eba-e29a-42fe-b62d-803c548711a5 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:31:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-d925f910-e733-41a0-81a0-cd3ff176232b tempest-SnapshotsActionsTest-1212491325 None] snapshot_file for this snap is: volume-96f19eba-e29a-42fe-b62d-803c548711a5.17165cba-a178-4ed0-b06b-40a32765f21b {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:31:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421" returned: 0 in 1.040s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421 {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:31:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Creating direct copy from snapshot {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:31:14 devstack cinder-volume[87016]: DEBUG cinder.utils [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Path /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2 not found in is_blk_device check {{(pid=87016) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 07:31:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:14 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[f754f0a7-8a82-4595-9c70-32a7b075281c]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d925f910-e733-41a0-81a0-cd3ff176232b tempest-SnapshotsActionsTest-1212491325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.17165cba-a178-4ed0-b06b-40a32765f21b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:14 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2 Nov 03 07:31:14 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:14 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.17165cba-a178-4ed0-b06b-40a32765f21b Nov 03 07:31:14 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:14 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d925f910-e733-41a0-81a0-cd3ff176232b tempest-SnapshotsActionsTest-1212491325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.17165cba-a178-4ed0-b06b-40a32765f21b" returned: 0 in 0.809s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-d925f910-e733-41a0-81a0-cd3ff176232b tempest-SnapshotsActionsTest-1212491325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96f19eba-e29a-42fe-b62d-803c548711a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:31:14 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f5d5b0-b486-42fe-9325-a7458b70a454]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d925f910-e733-41a0-81a0-cd3ff176232b tempest-SnapshotsActionsTest-1212491325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:15 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 Nov 03 07:31:15 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:16 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d925f910-e733-41a0-81a0-cd3ff176232b tempest-SnapshotsActionsTest-1212491325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078" returned: 0 in 1.078s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-d925f910-e733-41a0-81a0-cd3ff176232b tempest-SnapshotsActionsTest-1212491325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96f19eba-e29a-42fe-b62d-803c548711a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:31:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d925f910-e733-41a0-81a0-cd3ff176232b tempest-SnapshotsActionsTest-1212491325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.17165cba-a178-4ed0-b06b-40a32765f21b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:16 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.17165cba-a178-4ed0-b06b-40a32765f21b Nov 03 07:31:16 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:17 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d925f910-e733-41a0-81a0-cd3ff176232b tempest-SnapshotsActionsTest-1212491325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.17165cba-a178-4ed0-b06b-40a32765f21b" returned: 0 in 1.028s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d925f910-e733-41a0-81a0-cd3ff176232b tempest-SnapshotsActionsTest-1212491325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.17165cba-a178-4ed0-b06b-40a32765f21b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:17 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.17165cba-a178-4ed0-b06b-40a32765f21b Nov 03 07:31:17 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:17 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d925f910-e733-41a0-81a0-cd3ff176232b tempest-SnapshotsActionsTest-1212491325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.17165cba-a178-4ed0-b06b-40a32765f21b" returned: 0 in 0.917s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:18 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d925f910-e733-41a0-81a0-cd3ff176232b tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-quobyte-17165cba-a178-4ed0-b06b-40a32765f21b" released by "_delete_snapshot" :: held 4.191s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:18 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d925f910-e733-41a0-81a0-cd3ff176232b tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-quobyte-96f19eba-e29a-42fe-b62d-803c548711a5" released by "delete_snapshot" :: held 4.269s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:18 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-d925f910-e733-41a0-81a0-cd3ff176232b tempest-SnapshotsActionsTest-1212491325 None] Created reservations ['34c2ac38-6940-4535-acec-92fb189d9a4b', 'ba2e5508-a1b1-455c-b3c6-42002ab4b59c', '12914cc8-82a3-495a-be64-f6db3d511a9b', '96e636cb-9447-455e-9e0d-b714cd5d35ee'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:31:18 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-d925f910-e733-41a0-81a0-cd3ff176232b tempest-SnapshotsActionsTest-1212491325 None] Delete snapshot completed successfully. Nov 03 07:31:18 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d925f910-e733-41a0-81a0-cd3ff176232b tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-17165cba-a178-4ed0-b06b-40a32765f21b-delete_snapshot" released by "delete_snapshot" :: held 4.668s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-bba0ef76-9d4a-4298-900e-7cf9856ebc81 tempest-SnapshotsActionsTest-625008050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:24 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e162ed87-30d8-4f66-9e0a-c936e1ff8fee tempest-AttachVolumeTestJSON-654495122 None] Acquiring lock "cinder-74c962ca-269d-49c5-9895-16db9d68cd2e-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:24 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e162ed87-30d8-4f66-9e0a-c936e1ff8fee tempest-AttachVolumeTestJSON-654495122 None] Lock "cinder-74c962ca-269d-49c5-9895-16db9d68cd2e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:24 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e162ed87-30d8-4f66-9e0a-c936e1ff8fee tempest-AttachVolumeTestJSON-654495122 None] Acquiring lock "cinder-quobyte-74c962ca-269d-49c5-9895-16db9d68cd2e" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:24 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e162ed87-30d8-4f66-9e0a-c936e1ff8fee tempest-AttachVolumeTestJSON-654495122 None] Lock "cinder-quobyte-74c962ca-269d-49c5-9895-16db9d68cd2e" acquired by "delete_volume" :: waited 0.043s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:24 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0a330f-527f-4212-9233-da54e09e3797]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e162ed87-30d8-4f66-9e0a-c936e1ff8fee tempest-AttachVolumeTestJSON-654495122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-74c962ca-269d-49c5-9895-16db9d68cd2e {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:24 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-74c962ca-269d-49c5-9895-16db9d68cd2e Nov 03 07:31:24 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:25 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e162ed87-30d8-4f66-9e0a-c936e1ff8fee tempest-AttachVolumeTestJSON-654495122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-74c962ca-269d-49c5-9895-16db9d68cd2e" returned: 0 in 1.063s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e162ed87-30d8-4f66-9e0a-c936e1ff8fee tempest-AttachVolumeTestJSON-654495122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-74c962ca-269d-49c5-9895-16db9d68cd2e {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:25 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-74c962ca-269d-49c5-9895-16db9d68cd2e Nov 03 07:31:25 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:25 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2" returned: 0 in 11.847s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:25 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Image conversion details: src /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421, size 1024.00 MB, duration 11.85 sec, destination /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2 {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:31:25 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Converted 1024.00 MB image at 86.42 MB/s Nov 03 07:31:25 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2 is being set with open permissions: ugo+rw Nov 03 07:31:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:25 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2 Nov 03 07:31:25 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:26 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e162ed87-30d8-4f66-9e0a-c936e1ff8fee tempest-AttachVolumeTestJSON-654495122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-74c962ca-269d-49c5-9895-16db9d68cd2e" returned: 0 in 0.456s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e162ed87-30d8-4f66-9e0a-c936e1ff8fee tempest-AttachVolumeTestJSON-654495122 None] Lock "cinder-quobyte-74c962ca-269d-49c5-9895-16db9d68cd2e" released by "delete_volume" :: held 1.639s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-e162ed87-30d8-4f66-9e0a-c936e1ff8fee tempest-AttachVolumeTestJSON-654495122 None] Created reservations ['39526e85-1d6c-4221-8d60-20251196745a', '8a457ca1-01de-4c4b-ab1d-f10ce304a396', '6ff115ae-67f0-491b-9c81-bb3ca59123a1', 'f8436d3c-ff2a-41c1-95d9-d6052985d708'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:31:26 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2" returned: 0 in 0.358s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2" released by "_copy_volume_from_snapshot" :: held 13.945s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e162ed87-30d8-4f66-9e0a-c936e1ff8fee tempest-AttachVolumeTestJSON-654495122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e162ed87-30d8-4f66-9e0a-c936e1ff8fee tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e162ed87-30d8-4f66-9e0a-c936e1ff8fee tempest-AttachVolumeTestJSON-654495122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e162ed87-30d8-4f66-9e0a-c936e1ff8fee tempest-AttachVolumeTestJSON-654495122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e162ed87-30d8-4f66-9e0a-c936e1ff8fee tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e162ed87-30d8-4f66-9e0a-c936e1ff8fee tempest-AttachVolumeTestJSON-654495122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-54b4179d-d420-4cfa-a4bc-ccdac928cbcf-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2" released by "_create_volume_from_snapshot" :: held 14.094s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.148s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:26 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:31:26 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-bba0ef76-9d4a-4298-900e-7cf9856ebc81 tempest-SnapshotsActionsTest-625008050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.375s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-bba0ef76-9d4a-4298-900e-7cf9856ebc81 tempest-SnapshotsActionsTest-625008050 None] Creating offline snapshot f02c2835-82da-47d6-93b4-73a0eb83ee1f of volume 96f19eba-e29a-42fe-b62d-803c548711a5 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf3d0adb-12f0-44cc-b3a6-8c2c0eccabef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2', 'volume_size': 2, 'snapshot_id': '54b4179d-d420-4cfa-a4bc-ccdac928cbcf'}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec16c7c-db0e-4912-9579-3ca4a51581e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e44271c-5ff9-4244-9d01-8dabe67dfaaf]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bba0ef76-9d4a-4298-900e-7cf9856ebc81 tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:26 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Volume volume-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2 (5d9e44b5-5ef6-4ced-9390-aead92b5e5d2): created successfully Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec16c7c-db0e-4912-9579-3ca4a51581e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Flow 'volume_create_manager' (ed6fa55e-a69b-45b7-af26-3fba0cb44f48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:26 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-0802305d-9329-4728-ae04-739c9f4349b2 tempest-VolumesSnapshotTestJSON-1430329829 None] Created volume successfully. Nov 03 07:31:26 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 Nov 03 07:31:26 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:26 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e162ed87-30d8-4f66-9e0a-c936e1ff8fee tempest-AttachVolumeTestJSON-654495122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.441s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-e162ed87-30d8-4f66-9e0a-c936e1ff8fee tempest-AttachVolumeTestJSON-654495122 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:31:26 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-e162ed87-30d8-4f66-9e0a-c936e1ff8fee tempest-AttachVolumeTestJSON-654495122 None] Deleted volume successfully. Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e162ed87-30d8-4f66-9e0a-c936e1ff8fee tempest-AttachVolumeTestJSON-654495122 None] Lock "cinder-74c962ca-269d-49c5-9895-16db9d68cd2e-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f038631c-0a6e-4ce8-b3ec-0f7c9114f337 tempest-AttachVolumeTestJSON-654495122 None] Acquiring lock "cinder-ed80c8b2-d116-46bb-ad1a-f11866aa13de-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f038631c-0a6e-4ce8-b3ec-0f7c9114f337 tempest-AttachVolumeTestJSON-654495122 None] Lock "cinder-ed80c8b2-d116-46bb-ad1a-f11866aa13de-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f038631c-0a6e-4ce8-b3ec-0f7c9114f337 tempest-AttachVolumeTestJSON-654495122 None] Acquiring lock "cinder-quobyte-ed80c8b2-d116-46bb-ad1a-f11866aa13de" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f038631c-0a6e-4ce8-b3ec-0f7c9114f337 tempest-AttachVolumeTestJSON-654495122 None] Lock "cinder-quobyte-ed80c8b2-d116-46bb-ad1a-f11866aa13de" acquired by "delete_volume" :: waited 0.024s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bb8aa9-d087-4fe0-aa80-b259700e04a7]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f038631c-0a6e-4ce8-b3ec-0f7c9114f337 tempest-AttachVolumeTestJSON-654495122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed80c8b2-d116-46bb-ad1a-f11866aa13de {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:27 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bba0ef76-9d4a-4298-900e-7cf9856ebc81 tempest-SnapshotsActionsTest-625008050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078" returned: 0 in 0.535s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-bba0ef76-9d4a-4298-900e-7cf9856ebc81 tempest-SnapshotsActionsTest-625008050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96f19eba-e29a-42fe-b62d-803c548711a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:31:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bba0ef76-9d4a-4298-900e-7cf9856ebc81 tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.f02c2835-82da-47d6-93b4-73a0eb83ee1f 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:27 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.f02c2835-82da-47d6-93b4-73a0eb83ee1f 1G Nov 03 07:31:27 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:27 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed80c8b2-d116-46bb-ad1a-f11866aa13de Nov 03 07:31:27 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:27 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f038631c-0a6e-4ce8-b3ec-0f7c9114f337 tempest-AttachVolumeTestJSON-654495122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed80c8b2-d116-46bb-ad1a-f11866aa13de" returned: 0 in 0.454s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f038631c-0a6e-4ce8-b3ec-0f7c9114f337 tempest-AttachVolumeTestJSON-654495122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed80c8b2-d116-46bb-ad1a-f11866aa13de {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:27 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed80c8b2-d116-46bb-ad1a-f11866aa13de Nov 03 07:31:27 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:27 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bba0ef76-9d4a-4298-900e-7cf9856ebc81 tempest-SnapshotsActionsTest-625008050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.f02c2835-82da-47d6-93b4-73a0eb83ee1f 1G" returned: 0 in 0.538s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bba0ef76-9d4a-4298-900e-7cf9856ebc81 tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.f02c2835-82da-47d6-93b4-73a0eb83ee1f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:27 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.f02c2835-82da-47d6-93b4-73a0eb83ee1f Nov 03 07:31:27 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:27 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f038631c-0a6e-4ce8-b3ec-0f7c9114f337 tempest-AttachVolumeTestJSON-654495122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed80c8b2-d116-46bb-ad1a-f11866aa13de" returned: 0 in 0.339s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:27 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-af0ca24e-f890-41e1-85df-687c34d7f12b tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "cinder-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:27 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f038631c-0a6e-4ce8-b3ec-0f7c9114f337 tempest-AttachVolumeTestJSON-654495122 None] Lock "cinder-quobyte-ed80c8b2-d116-46bb-ad1a-f11866aa13de" released by "delete_volume" :: held 0.847s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:27 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-af0ca24e-f890-41e1-85df-687c34d7f12b tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:27 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-af0ca24e-f890-41e1-85df-687c34d7f12b tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "cinder-quobyte-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:27 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-af0ca24e-f890-41e1-85df-687c34d7f12b tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2" acquired by "delete_volume" :: waited 0.031s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:27 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-f038631c-0a6e-4ce8-b3ec-0f7c9114f337 tempest-AttachVolumeTestJSON-654495122 None] Created reservations ['a340270c-7f87-47c6-8c2b-b2cffc9b7c64', 'b47ec0e6-9952-4a99-b1c5-820ce11b3285', '5f8793d8-9c82-4504-ad31-dc06fbc80706', 'bcfbae88-7831-4657-981f-e6620161c245'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:31:27 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abfca4f-8394-4c19-ab74-a239a0404e2e]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-af0ca24e-f890-41e1-85df-687c34d7f12b tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:28 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bba0ef76-9d4a-4298-900e-7cf9856ebc81 tempest-SnapshotsActionsTest-625008050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.f02c2835-82da-47d6-93b4-73a0eb83ee1f" returned: 0 in 0.500s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:28 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-bba0ef76-9d4a-4298-900e-7cf9856ebc81 tempest-SnapshotsActionsTest-625008050 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.f02c2835-82da-47d6-93b4-73a0eb83ee1f is being set with open permissions: ugo+rw Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bba0ef76-9d4a-4298-900e-7cf9856ebc81 tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.f02c2835-82da-47d6-93b4-73a0eb83ee1f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f038631c-0a6e-4ce8-b3ec-0f7c9114f337 tempest-AttachVolumeTestJSON-654495122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:28 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.f02c2835-82da-47d6-93b4-73a0eb83ee1f Nov 03 07:31:28 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f038631c-0a6e-4ce8-b3ec-0f7c9114f337 tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f038631c-0a6e-4ce8-b3ec-0f7c9114f337 tempest-AttachVolumeTestJSON-654495122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f038631c-0a6e-4ce8-b3ec-0f7c9114f337 tempest-AttachVolumeTestJSON-654495122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f038631c-0a6e-4ce8-b3ec-0f7c9114f337 tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f038631c-0a6e-4ce8-b3ec-0f7c9114f337 tempest-AttachVolumeTestJSON-654495122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:28 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2 Nov 03 07:31:28 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:28 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:31:28 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:28 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bba0ef76-9d4a-4298-900e-7cf9856ebc81 tempest-SnapshotsActionsTest-625008050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.f02c2835-82da-47d6-93b4-73a0eb83ee1f" returned: 0 in 0.330s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:28 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-bba0ef76-9d4a-4298-900e-7cf9856ebc81 tempest-SnapshotsActionsTest-625008050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.124s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f038631c-0a6e-4ce8-b3ec-0f7c9114f337 tempest-AttachVolumeTestJSON-654495122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.337s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-f038631c-0a6e-4ce8-b3ec-0f7c9114f337 tempest-AttachVolumeTestJSON-654495122 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:31:28 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-f038631c-0a6e-4ce8-b3ec-0f7c9114f337 tempest-AttachVolumeTestJSON-654495122 None] Deleted volume successfully. Nov 03 07:31:28 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-af0ca24e-f890-41e1-85df-687c34d7f12b tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2" returned: 0 in 0.533s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-af0ca24e-f890-41e1-85df-687c34d7f12b tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:28 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-bba0ef76-9d4a-4298-900e-7cf9856ebc81 tempest-SnapshotsActionsTest-625008050 None] Create snapshot completed successfully Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f038631c-0a6e-4ce8-b3ec-0f7c9114f337 tempest-AttachVolumeTestJSON-654495122 None] Lock "cinder-ed80c8b2-d116-46bb-ad1a-f11866aa13de-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:28 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2 Nov 03 07:31:28 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2cb01e74-ee34-4b2a-b2c7-f175874c30b6 tempest-SnapshotsActionsTest-1212491325 None] Acquiring lock "cinder-f02c2835-82da-47d6-93b4-73a0eb83ee1f-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2cb01e74-ee34-4b2a-b2c7-f175874c30b6 tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-f02c2835-82da-47d6-93b4-73a0eb83ee1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2cb01e74-ee34-4b2a-b2c7-f175874c30b6 tempest-SnapshotsActionsTest-1212491325 None] Acquiring lock "cinder-quobyte-96f19eba-e29a-42fe-b62d-803c548711a5" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2cb01e74-ee34-4b2a-b2c7-f175874c30b6 tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-quobyte-96f19eba-e29a-42fe-b62d-803c548711a5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2cb01e74-ee34-4b2a-b2c7-f175874c30b6 tempest-SnapshotsActionsTest-1212491325 None] Acquiring lock "cinder-quobyte-f02c2835-82da-47d6-93b4-73a0eb83ee1f" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:28 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-af0ca24e-f890-41e1-85df-687c34d7f12b tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2" returned: 0 in 0.324s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2cb01e74-ee34-4b2a-b2c7-f175874c30b6 tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-quobyte-f02c2835-82da-47d6-93b4-73a0eb83ee1f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-2cb01e74-ee34-4b2a-b2c7-f175874c30b6 tempest-SnapshotsActionsTest-1212491325 None] Deleting offline snapshot f02c2835-82da-47d6-93b4-73a0eb83ee1f of volume 96f19eba-e29a-42fe-b62d-803c548711a5 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-2cb01e74-ee34-4b2a-b2c7-f175874c30b6 tempest-SnapshotsActionsTest-1212491325 None] snapshot_file for this snap is: volume-96f19eba-e29a-42fe-b62d-803c548711a5.f02c2835-82da-47d6-93b4-73a0eb83ee1f {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-af0ca24e-f890-41e1-85df-687c34d7f12b tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2" released by "delete_volume" :: held 0.950s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7eb41f-8da9-4036-b5d2-152381d2cc11]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2cb01e74-ee34-4b2a-b2c7-f175874c30b6 tempest-SnapshotsActionsTest-1212491325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.f02c2835-82da-47d6-93b4-73a0eb83ee1f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:28 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-af0ca24e-f890-41e1-85df-687c34d7f12b tempest-VolumesSnapshotTestJSON-1430329829 None] Created reservations ['f0322b77-7a4e-49be-a40d-fbb3b3124ce2', 'cd9a7c84-f5d4-4ad4-bda3-614005f69351', '4d38c123-fad1-4271-a63b-673177bab8d1', 'cebdc5d7-47c9-492e-82f5-df0a4aa49eb0'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:31:29 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.f02c2835-82da-47d6-93b4-73a0eb83ee1f Nov 03 07:31:29 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-af0ca24e-f890-41e1-85df-687c34d7f12b tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-af0ca24e-f890-41e1-85df-687c34d7f12b tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-af0ca24e-f890-41e1-85df-687c34d7f12b tempest-VolumesSnapshotTestJSON-1430329829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-af0ca24e-f890-41e1-85df-687c34d7f12b tempest-VolumesSnapshotTestJSON-1430329829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-af0ca24e-f890-41e1-85df-687c34d7f12b tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-af0ca24e-f890-41e1-85df-687c34d7f12b tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:29 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:31:29 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9d386599-f781-4814-b8f4-5acb664fd031 tempest-AttachVolumeTestJSON-654495122 None] Acquiring lock "cinder-9de21125-8feb-43c2-8702-580e7d478842-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9d386599-f781-4814-b8f4-5acb664fd031 tempest-AttachVolumeTestJSON-654495122 None] Lock "cinder-9de21125-8feb-43c2-8702-580e7d478842-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9d386599-f781-4814-b8f4-5acb664fd031 tempest-AttachVolumeTestJSON-654495122 None] Acquiring lock "cinder-quobyte-9de21125-8feb-43c2-8702-580e7d478842" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9d386599-f781-4814-b8f4-5acb664fd031 tempest-AttachVolumeTestJSON-654495122 None] Lock "cinder-quobyte-9de21125-8feb-43c2-8702-580e7d478842" acquired by "delete_volume" :: waited 0.025s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:29 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2cb01e74-ee34-4b2a-b2c7-f175874c30b6 tempest-SnapshotsActionsTest-1212491325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.f02c2835-82da-47d6-93b4-73a0eb83ee1f" returned: 0 in 0.553s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-2cb01e74-ee34-4b2a-b2c7-f175874c30b6 tempest-SnapshotsActionsTest-1212491325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96f19eba-e29a-42fe-b62d-803c548711a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[992e63de-1ce1-43f3-bfab-bea76a49884e]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9d386599-f781-4814-b8f4-5acb664fd031 tempest-AttachVolumeTestJSON-654495122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9de21125-8feb-43c2-8702-580e7d478842 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eac820c-5d5a-4ec8-863d-17cb138a8ac5]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2cb01e74-ee34-4b2a-b2c7-f175874c30b6 tempest-SnapshotsActionsTest-1212491325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:29 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-af0ca24e-f890-41e1-85df-687c34d7f12b tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.451s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-af0ca24e-f890-41e1-85df-687c34d7f12b tempest-VolumesSnapshotTestJSON-1430329829 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:31:29 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-af0ca24e-f890-41e1-85df-687c34d7f12b tempest-VolumesSnapshotTestJSON-1430329829 None] Deleted volume successfully. Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-af0ca24e-f890-41e1-85df-687c34d7f12b tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-5d9e44b5-5ef6-4ced-9390-aead92b5e5d2-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:29 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9de21125-8feb-43c2-8702-580e7d478842 Nov 03 07:31:29 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:29 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 Nov 03 07:31:29 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:29 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2cb01e74-ee34-4b2a-b2c7-f175874c30b6 tempest-SnapshotsActionsTest-1212491325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078" returned: 0 in 0.435s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-2cb01e74-ee34-4b2a-b2c7-f175874c30b6 tempest-SnapshotsActionsTest-1212491325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96f19eba-e29a-42fe-b62d-803c548711a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2cb01e74-ee34-4b2a-b2c7-f175874c30b6 tempest-SnapshotsActionsTest-1212491325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.f02c2835-82da-47d6-93b4-73a0eb83ee1f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:29 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9d386599-f781-4814-b8f4-5acb664fd031 tempest-AttachVolumeTestJSON-654495122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9de21125-8feb-43c2-8702-580e7d478842" returned: 0 in 0.483s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9d386599-f781-4814-b8f4-5acb664fd031 tempest-AttachVolumeTestJSON-654495122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9de21125-8feb-43c2-8702-580e7d478842 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:29 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.f02c2835-82da-47d6-93b4-73a0eb83ee1f Nov 03 07:31:29 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:30 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9de21125-8feb-43c2-8702-580e7d478842 Nov 03 07:31:30 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2dec2c2d-a20f-440d-b3c7-fd3a927acfaa tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "cinder-54b4179d-d420-4cfa-a4bc-ccdac928cbcf-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2dec2c2d-a20f-440d-b3c7-fd3a927acfaa tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-54b4179d-d420-4cfa-a4bc-ccdac928cbcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2dec2c2d-a20f-440d-b3c7-fd3a927acfaa tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "cinder-quobyte-4c14e388-f124-497a-8bb7-73fab40c9421" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2dec2c2d-a20f-440d-b3c7-fd3a927acfaa tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-4c14e388-f124-497a-8bb7-73fab40c9421" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2dec2c2d-a20f-440d-b3c7-fd3a927acfaa tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "cinder-quobyte-54b4179d-d420-4cfa-a4bc-ccdac928cbcf" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2dec2c2d-a20f-440d-b3c7-fd3a927acfaa tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-54b4179d-d420-4cfa-a4bc-ccdac928cbcf" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-2dec2c2d-a20f-440d-b3c7-fd3a927acfaa tempest-VolumesSnapshotTestJSON-1430329829 None] Deleting offline snapshot 54b4179d-d420-4cfa-a4bc-ccdac928cbcf of volume 4c14e388-f124-497a-8bb7-73fab40c9421 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-2dec2c2d-a20f-440d-b3c7-fd3a927acfaa tempest-VolumesSnapshotTestJSON-1430329829 None] snapshot_file for this snap is: volume-4c14e388-f124-497a-8bb7-73fab40c9421.54b4179d-d420-4cfa-a4bc-ccdac928cbcf {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d519d7-b4f8-4d63-9839-afccdc6a0afd]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2dec2c2d-a20f-440d-b3c7-fd3a927acfaa tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.54b4179d-d420-4cfa-a4bc-ccdac928cbcf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:30 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9d386599-f781-4814-b8f4-5acb664fd031 tempest-AttachVolumeTestJSON-654495122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9de21125-8feb-43c2-8702-580e7d478842" returned: 0 in 0.482s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:30 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2cb01e74-ee34-4b2a-b2c7-f175874c30b6 tempest-SnapshotsActionsTest-1212491325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.f02c2835-82da-47d6-93b4-73a0eb83ee1f" returned: 0 in 0.539s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2cb01e74-ee34-4b2a-b2c7-f175874c30b6 tempest-SnapshotsActionsTest-1212491325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.f02c2835-82da-47d6-93b4-73a0eb83ee1f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9d386599-f781-4814-b8f4-5acb664fd031 tempest-AttachVolumeTestJSON-654495122 None] Lock "cinder-quobyte-9de21125-8feb-43c2-8702-580e7d478842" released by "delete_volume" :: held 1.078s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:30 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.54b4179d-d420-4cfa-a4bc-ccdac928cbcf Nov 03 07:31:30 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:30 devstack sudo[96993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.f02c2835-82da-47d6-93b4-73a0eb83ee1f Nov 03 07:31:30 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-9d386599-f781-4814-b8f4-5acb664fd031 tempest-AttachVolumeTestJSON-654495122 None] Created reservations ['fb435105-9979-42e1-9ae1-8ee60b065edc', 'f762b3e4-7985-4a9d-9431-1350b45e553d', 'f8955213-b636-4c1e-9e8c-1a9edd38fc57', 'eb97cf74-c742-43fc-9175-1368c69aec8a'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9d386599-f781-4814-b8f4-5acb664fd031 tempest-AttachVolumeTestJSON-654495122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9d386599-f781-4814-b8f4-5acb664fd031 tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9d386599-f781-4814-b8f4-5acb664fd031 tempest-AttachVolumeTestJSON-654495122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9d386599-f781-4814-b8f4-5acb664fd031 tempest-AttachVolumeTestJSON-654495122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9d386599-f781-4814-b8f4-5acb664fd031 tempest-AttachVolumeTestJSON-654495122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9d386599-f781-4814-b8f4-5acb664fd031 tempest-AttachVolumeTestJSON-654495122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:30 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:31:30 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:30 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2cb01e74-ee34-4b2a-b2c7-f175874c30b6 tempest-SnapshotsActionsTest-1212491325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.f02c2835-82da-47d6-93b4-73a0eb83ee1f" returned: 0 in 0.394s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:30 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2dec2c2d-a20f-440d-b3c7-fd3a927acfaa tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.54b4179d-d420-4cfa-a4bc-ccdac928cbcf" returned: 0 in 0.596s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-2dec2c2d-a20f-440d-b3c7-fd3a927acfaa tempest-VolumesSnapshotTestJSON-1430329829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c14e388-f124-497a-8bb7-73fab40c9421(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2cb01e74-ee34-4b2a-b2c7-f175874c30b6 tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-quobyte-f02c2835-82da-47d6-93b4-73a0eb83ee1f" released by "_delete_snapshot" :: held 2.114s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2cb01e74-ee34-4b2a-b2c7-f175874c30b6 tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-quobyte-96f19eba-e29a-42fe-b62d-803c548711a5" released by "delete_snapshot" :: held 2.157s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[df27c525-5895-4007-af6e-65dd95b66e8c]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2dec2c2d-a20f-440d-b3c7-fd3a927acfaa tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:31 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9d386599-f781-4814-b8f4-5acb664fd031 tempest-AttachVolumeTestJSON-654495122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.346s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:31 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-9d386599-f781-4814-b8f4-5acb664fd031 tempest-AttachVolumeTestJSON-654495122 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:31:31 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-9d386599-f781-4814-b8f4-5acb664fd031 tempest-AttachVolumeTestJSON-654495122 None] Deleted volume successfully. Nov 03 07:31:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9d386599-f781-4814-b8f4-5acb664fd031 tempest-AttachVolumeTestJSON-654495122 None] Lock "cinder-9de21125-8feb-43c2-8702-580e7d478842-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:31 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421 Nov 03 07:31:31 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:31 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-2cb01e74-ee34-4b2a-b2c7-f175874c30b6 tempest-SnapshotsActionsTest-1212491325 None] Created reservations ['a3f48f92-6d2d-4859-967e-7f8c9cebb5f0', '087cfa33-cfda-415e-ad96-3c0a6c157ea5', 'c5092aba-b776-4ccf-be6a-b71cdb4dfb92', '04ef9427-3da7-4885-92c2-c52c4d6786af'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:31:31 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-2cb01e74-ee34-4b2a-b2c7-f175874c30b6 tempest-SnapshotsActionsTest-1212491325 None] Delete snapshot completed successfully. Nov 03 07:31:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2cb01e74-ee34-4b2a-b2c7-f175874c30b6 tempest-SnapshotsActionsTest-1212491325 None] Lock "cinder-f02c2835-82da-47d6-93b4-73a0eb83ee1f-delete_snapshot" released by "delete_snapshot" :: held 2.563s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:31 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2dec2c2d-a20f-440d-b3c7-fd3a927acfaa tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421" returned: 0 in 0.754s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2dec2c2d-a20f-440d-b3c7-fd3a927acfaa tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.54b4179d-d420-4cfa-a4bc-ccdac928cbcf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:31 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.54b4179d-d420-4cfa-a4bc-ccdac928cbcf Nov 03 07:31:31 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:32 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2dec2c2d-a20f-440d-b3c7-fd3a927acfaa tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.54b4179d-d420-4cfa-a4bc-ccdac928cbcf" returned: 0 in 0.520s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2dec2c2d-a20f-440d-b3c7-fd3a927acfaa tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.54b4179d-d420-4cfa-a4bc-ccdac928cbcf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:32 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.54b4179d-d420-4cfa-a4bc-ccdac928cbcf Nov 03 07:31:32 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:32 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2dec2c2d-a20f-440d-b3c7-fd3a927acfaa tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421.54b4179d-d420-4cfa-a4bc-ccdac928cbcf" returned: 0 in 0.322s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2dec2c2d-a20f-440d-b3c7-fd3a927acfaa tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-54b4179d-d420-4cfa-a4bc-ccdac928cbcf" released by "_delete_snapshot" :: held 2.354s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2dec2c2d-a20f-440d-b3c7-fd3a927acfaa tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-4c14e388-f124-497a-8bb7-73fab40c9421" released by "delete_snapshot" :: held 2.390s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:32 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-2dec2c2d-a20f-440d-b3c7-fd3a927acfaa tempest-VolumesSnapshotTestJSON-1430329829 None] Created reservations ['bfb20a6d-5a76-4a47-8339-d101e4e81fb3', 'b755c92f-0ccb-4e67-a970-f780b04add37', 'e3c06025-9ae2-4c5b-85bd-0e9836f944f1', '4a78c159-cb8e-4422-afdb-06f8154ba933'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:31:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c1448f06-2747-4816-b5c2-ea3f0c4eacd8 tempest-SnapshotsActionsTest-625008050 None] Acquiring lock "cinder-77fca04d-b16c-4e7e-a9d0-a513289d3078-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c1448f06-2747-4816-b5c2-ea3f0c4eacd8 tempest-SnapshotsActionsTest-625008050 None] Lock "cinder-77fca04d-b16c-4e7e-a9d0-a513289d3078-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c1448f06-2747-4816-b5c2-ea3f0c4eacd8 tempest-SnapshotsActionsTest-625008050 None] Acquiring lock "cinder-quobyte-96f19eba-e29a-42fe-b62d-803c548711a5" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:32 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-2dec2c2d-a20f-440d-b3c7-fd3a927acfaa tempest-VolumesSnapshotTestJSON-1430329829 None] Delete snapshot completed successfully. Nov 03 07:31:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c1448f06-2747-4816-b5c2-ea3f0c4eacd8 tempest-SnapshotsActionsTest-625008050 None] Lock "cinder-quobyte-96f19eba-e29a-42fe-b62d-803c548711a5" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c1448f06-2747-4816-b5c2-ea3f0c4eacd8 tempest-SnapshotsActionsTest-625008050 None] Acquiring lock "cinder-quobyte-77fca04d-b16c-4e7e-a9d0-a513289d3078" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2dec2c2d-a20f-440d-b3c7-fd3a927acfaa tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-54b4179d-d420-4cfa-a4bc-ccdac928cbcf-delete_snapshot" released by "delete_snapshot" :: held 2.670s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c1448f06-2747-4816-b5c2-ea3f0c4eacd8 tempest-SnapshotsActionsTest-625008050 None] Lock "cinder-quobyte-77fca04d-b16c-4e7e-a9d0-a513289d3078" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:32 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-c1448f06-2747-4816-b5c2-ea3f0c4eacd8 tempest-SnapshotsActionsTest-625008050 None] Deleting offline snapshot 77fca04d-b16c-4e7e-a9d0-a513289d3078 of volume 96f19eba-e29a-42fe-b62d-803c548711a5 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:31:32 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-c1448f06-2747-4816-b5c2-ea3f0c4eacd8 tempest-SnapshotsActionsTest-625008050 None] snapshot_file for this snap is: volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:31:33 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[691518d8-6ea3-4d2d-9f87-856ce329d1b7]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1448f06-2747-4816-b5c2-ea3f0c4eacd8 tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:33 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 Nov 03 07:31:33 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:33 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1448f06-2747-4816-b5c2-ea3f0c4eacd8 tempest-SnapshotsActionsTest-625008050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078" returned: 0 in 0.444s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-c1448f06-2747-4816-b5c2-ea3f0c4eacd8 tempest-SnapshotsActionsTest-625008050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96f19eba-e29a-42fe-b62d-803c548711a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:31:33 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c91f191-16e5-4e02-bdcf-4121da6d68c9]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1448f06-2747-4816-b5c2-ea3f0c4eacd8 tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6f54d34d-150f-40b3-bab0-3c9ed39016e9 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "cinder-4c14e388-f124-497a-8bb7-73fab40c9421-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6f54d34d-150f-40b3-bab0-3c9ed39016e9 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-4c14e388-f124-497a-8bb7-73fab40c9421-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6f54d34d-150f-40b3-bab0-3c9ed39016e9 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "cinder-quobyte-4c14e388-f124-497a-8bb7-73fab40c9421" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6f54d34d-150f-40b3-bab0-3c9ed39016e9 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-4c14e388-f124-497a-8bb7-73fab40c9421" acquired by "delete_volume" :: waited 0.018s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:33 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5 Nov 03 07:31:33 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:33 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[361e9a64-3a96-4b4e-b469-6d6e9bcf53d9]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6f54d34d-150f-40b3-bab0-3c9ed39016e9 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:33 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421 Nov 03 07:31:33 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:34 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1448f06-2747-4816-b5c2-ea3f0c4eacd8 tempest-SnapshotsActionsTest-625008050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5" returned: 0 in 0.562s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1448f06-2747-4816-b5c2-ea3f0c4eacd8 tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:34 devstack sudo[97047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 Nov 03 07:31:34 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:34 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6f54d34d-150f-40b3-bab0-3c9ed39016e9 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421" returned: 0 in 0.479s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6f54d34d-150f-40b3-bab0-3c9ed39016e9 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:34 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421 Nov 03 07:31:34 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:34 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1448f06-2747-4816-b5c2-ea3f0c4eacd8 tempest-SnapshotsActionsTest-625008050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078" returned: 0 in 0.440s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1448f06-2747-4816-b5c2-ea3f0c4eacd8 tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:34 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6f54d34d-150f-40b3-bab0-3c9ed39016e9 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c14e388-f124-497a-8bb7-73fab40c9421" returned: 0 in 0.338s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:34 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078 Nov 03 07:31:34 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6f54d34d-150f-40b3-bab0-3c9ed39016e9 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-4c14e388-f124-497a-8bb7-73fab40c9421" released by "delete_volume" :: held 0.913s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:34 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-6f54d34d-150f-40b3-bab0-3c9ed39016e9 tempest-VolumesSnapshotTestJSON-1430329829 None] Created reservations ['9c7253c1-99fe-4e18-8854-89f9eec4d986', '62363999-e82a-45f1-b1e4-a1b5fc192f2f', 'de34ec10-675f-42c9-9286-8ff079bf2ff8', 'dc70984b-0d8d-429f-a2a8-ccafc1cc5db9'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:31:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6f54d34d-150f-40b3-bab0-3c9ed39016e9 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6f54d34d-150f-40b3-bab0-3c9ed39016e9 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6f54d34d-150f-40b3-bab0-3c9ed39016e9 tempest-VolumesSnapshotTestJSON-1430329829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6f54d34d-150f-40b3-bab0-3c9ed39016e9 tempest-VolumesSnapshotTestJSON-1430329829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6f54d34d-150f-40b3-bab0-3c9ed39016e9 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6f54d34d-150f-40b3-bab0-3c9ed39016e9 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:34 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:31:34 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:34 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1448f06-2747-4816-b5c2-ea3f0c4eacd8 tempest-SnapshotsActionsTest-625008050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5.77fca04d-b16c-4e7e-a9d0-a513289d3078" returned: 0 in 0.372s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c1448f06-2747-4816-b5c2-ea3f0c4eacd8 tempest-SnapshotsActionsTest-625008050 None] Lock "cinder-quobyte-77fca04d-b16c-4e7e-a9d0-a513289d3078" released by "_delete_snapshot" :: held 2.017s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c1448f06-2747-4816-b5c2-ea3f0c4eacd8 tempest-SnapshotsActionsTest-625008050 None] Lock "cinder-quobyte-96f19eba-e29a-42fe-b62d-803c548711a5" released by "delete_snapshot" :: held 2.054s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:35 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-c1448f06-2747-4816-b5c2-ea3f0c4eacd8 tempest-SnapshotsActionsTest-625008050 None] Created reservations ['4b6e9e07-96c5-48f9-bb46-25a20c39e4c8', 'e773031e-da0c-4de5-ad3b-ca60dd544048', 'fd8d15c0-a791-4b05-904b-96a49147b203', 'c65d95fd-2088-4406-9108-1846ff3199c4'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:31:35 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6f54d34d-150f-40b3-bab0-3c9ed39016e9 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.313s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:35 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-6f54d34d-150f-40b3-bab0-3c9ed39016e9 tempest-VolumesSnapshotTestJSON-1430329829 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:31:35 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-6f54d34d-150f-40b3-bab0-3c9ed39016e9 tempest-VolumesSnapshotTestJSON-1430329829 None] Deleted volume successfully. Nov 03 07:31:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6f54d34d-150f-40b3-bab0-3c9ed39016e9 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-4c14e388-f124-497a-8bb7-73fab40c9421-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:35 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-c1448f06-2747-4816-b5c2-ea3f0c4eacd8 tempest-SnapshotsActionsTest-625008050 None] Delete snapshot completed successfully. Nov 03 07:31:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c1448f06-2747-4816-b5c2-ea3f0c4eacd8 tempest-SnapshotsActionsTest-625008050 None] Lock "cinder-77fca04d-b16c-4e7e-a9d0-a513289d3078-delete_snapshot" released by "delete_snapshot" :: held 2.284s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-042c296b-8e1e-4d83-ab5a-6a7fb5d9b80e tempest-SnapshotsActionsTest-625008050 None] Acquiring lock "cinder-96f19eba-e29a-42fe-b62d-803c548711a5-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-042c296b-8e1e-4d83-ab5a-6a7fb5d9b80e tempest-SnapshotsActionsTest-625008050 None] Lock "cinder-96f19eba-e29a-42fe-b62d-803c548711a5-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-042c296b-8e1e-4d83-ab5a-6a7fb5d9b80e tempest-SnapshotsActionsTest-625008050 None] Acquiring lock "cinder-quobyte-96f19eba-e29a-42fe-b62d-803c548711a5" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-042c296b-8e1e-4d83-ab5a-6a7fb5d9b80e tempest-SnapshotsActionsTest-625008050 None] Lock "cinder-quobyte-96f19eba-e29a-42fe-b62d-803c548711a5" acquired by "delete_volume" :: waited 0.022s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[8856924a-daab-482c-9603-633954d1a1a0]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-042c296b-8e1e-4d83-ab5a-6a7fb5d9b80e tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Flow 'volume_create_manager' (ed94f2d4-fa18-466b-95c4-5908afdedf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:36 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5 Nov 03 07:31:36 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fe7417-bbd7-4e67-9fdb-8cde0a22aa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fe7417-bbd7-4e67-9fdb-8cde0a22aa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-297932248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef528b9df2274d4096e2f40b55543323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:36Z,use_quota=True,user_id='e15721895a724e67be53f59d2b84d68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ffadde0-0c68-48c3-a400-06583ab9fc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ffadde0-0c68-48c3-a400-06583ab9fc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c1c378-0b60-49a8-8fbf-d44468cc97f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c1c378-0b60-49a8-8fbf-d44468cc97f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b', 'volume_name': 'volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4461dbf-823d-46dc-9297-8c42bf5cd724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4461dbf-823d-46dc-9297-8c42bf5cd724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e01712-51db-4ce8-8230-a0472792da05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:36 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Volume 3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b', 'volume_size': 1} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-297932248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef528b9df2274d4096e2f40b55543323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:36Z,use_quota=True,user_id='e15721895a724e67be53f59d2b84d68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Creating volume 3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:31:36 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:36 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b 1073741824 Nov 03 07:31:36 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:36 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-042c296b-8e1e-4d83-ab5a-6a7fb5d9b80e tempest-SnapshotsActionsTest-625008050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5" returned: 0 in 0.437s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-042c296b-8e1e-4d83-ab5a-6a7fb5d9b80e tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:36 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5 Nov 03 07:31:36 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:37 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-042c296b-8e1e-4d83-ab5a-6a7fb5d9b80e tempest-SnapshotsActionsTest-625008050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-96f19eba-e29a-42fe-b62d-803c548711a5" returned: 0 in 0.304s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-042c296b-8e1e-4d83-ab5a-6a7fb5d9b80e tempest-SnapshotsActionsTest-625008050 None] Lock "cinder-quobyte-96f19eba-e29a-42fe-b62d-803c548711a5" released by "delete_volume" :: held 0.835s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:37 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b 1073741824" returned: 0 in 0.568s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:37 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-042c296b-8e1e-4d83-ab5a-6a7fb5d9b80e tempest-SnapshotsActionsTest-625008050 None] Created reservations ['bfa4a17e-201e-47d4-8549-7f1b22f1003d', 'b32ed19c-0500-4ca4-9d3a-b989311feecc', '6dc6a463-44c2-46ca-b1db-a4277281e9fd', 'b590ca4c-5e20-4c54-83ce-7673bf87e0b2'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:31:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:37 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b Nov 03 07:31:37 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-042c296b-8e1e-4d83-ab5a-6a7fb5d9b80e tempest-SnapshotsActionsTest-625008050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-042c296b-8e1e-4d83-ab5a-6a7fb5d9b80e tempest-SnapshotsActionsTest-625008050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:37 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-042c296b-8e1e-4d83-ab5a-6a7fb5d9b80e tempest-SnapshotsActionsTest-625008050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:37 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-042c296b-8e1e-4d83-ab5a-6a7fb5d9b80e tempest-SnapshotsActionsTest-625008050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-042c296b-8e1e-4d83-ab5a-6a7fb5d9b80e tempest-SnapshotsActionsTest-625008050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-042c296b-8e1e-4d83-ab5a-6a7fb5d9b80e tempest-SnapshotsActionsTest-625008050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:37 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:31:37 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:37 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b" returned: 0 in 0.465s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:37 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:31:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e01712-51db-4ce8-8230-a0472792da05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb81c535-a191-4074-99f7-ad8b0ab6bbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:37 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Volume volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b (3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b): created successfully Nov 03 07:31:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb81c535-a191-4074-99f7-ad8b0ab6bbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Flow 'volume_create_manager' (ed94f2d4-fa18-466b-95c4-5908afdedf6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:37 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-964cde7c-a1b3-4669-b30b-f72810727ff2 tempest-VolumesSnapshotTestJSON-1430329829 None] Created volume successfully. Nov 03 07:31:37 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-042c296b-8e1e-4d83-ab5a-6a7fb5d9b80e tempest-SnapshotsActionsTest-625008050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.396s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:37 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-042c296b-8e1e-4d83-ab5a-6a7fb5d9b80e tempest-SnapshotsActionsTest-625008050 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:31:37 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-042c296b-8e1e-4d83-ab5a-6a7fb5d9b80e tempest-SnapshotsActionsTest-625008050 None] Deleted volume successfully. Nov 03 07:31:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-042c296b-8e1e-4d83-ab5a-6a7fb5d9b80e tempest-SnapshotsActionsTest-625008050 None] Lock "cinder-96f19eba-e29a-42fe-b62d-803c548711a5-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-03db0bef-82b0-4edf-8fc1-9e89c5b49c64 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-03db0bef-82b0-4edf-8fc1-9e89c5b49c64 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-03db0bef-82b0-4edf-8fc1-9e89c5b49c64 tempest-VolumesSnapshotTestJSON-1430329829 None] Creating offline snapshot be957f08-5864-4a38-9253-587b52363f3a of volume 3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:31:39 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a4de89-5b5d-4a05-b6ac-bbbdcca1d714]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-03db0bef-82b0-4edf-8fc1-9e89c5b49c64 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:39 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b Nov 03 07:31:39 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:39 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-03db0bef-82b0-4edf-8fc1-9e89c5b49c64 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b" returned: 0 in 0.472s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-03db0bef-82b0-4edf-8fc1-9e89c5b49c64 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.be957f08-5864-4a38-9253-587b52363f3a 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:39 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.be957f08-5864-4a38-9253-587b52363f3a 1G Nov 03 07:31:39 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:40 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-03db0bef-82b0-4edf-8fc1-9e89c5b49c64 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.be957f08-5864-4a38-9253-587b52363f3a 1G" returned: 0 in 0.636s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-03db0bef-82b0-4edf-8fc1-9e89c5b49c64 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.be957f08-5864-4a38-9253-587b52363f3a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:40 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.be957f08-5864-4a38-9253-587b52363f3a Nov 03 07:31:40 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:40 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-03db0bef-82b0-4edf-8fc1-9e89c5b49c64 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.be957f08-5864-4a38-9253-587b52363f3a" returned: 0 in 0.475s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:40 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-03db0bef-82b0-4edf-8fc1-9e89c5b49c64 tempest-VolumesSnapshotTestJSON-1430329829 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.be957f08-5864-4a38-9253-587b52363f3a is being set with open permissions: ugo+rw Nov 03 07:31:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-03db0bef-82b0-4edf-8fc1-9e89c5b49c64 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.be957f08-5864-4a38-9253-587b52363f3a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:40 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.be957f08-5864-4a38-9253-587b52363f3a Nov 03 07:31:40 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:41 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-03db0bef-82b0-4edf-8fc1-9e89c5b49c64 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.be957f08-5864-4a38-9253-587b52363f3a" returned: 0 in 0.402s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-03db0bef-82b0-4edf-8fc1-9e89c5b49c64 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:41 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.info Nov 03 07:31:41 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:41 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-03db0bef-82b0-4edf-8fc1-9e89c5b49c64 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.info" returned: 0 in 0.409s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:41 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-03db0bef-82b0-4edf-8fc1-9e89c5b49c64 tempest-VolumesSnapshotTestJSON-1430329829 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.info is being set with open permissions: ugo+rw Nov 03 07:31:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-03db0bef-82b0-4edf-8fc1-9e89c5b49c64 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:41 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.info Nov 03 07:31:41 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:42 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-03db0bef-82b0-4edf-8fc1-9e89c5b49c64 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.info" returned: 0 in 0.404s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-03db0bef-82b0-4edf-8fc1-9e89c5b49c64 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.953s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:42 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-03db0bef-82b0-4edf-8fc1-9e89c5b49c64 tempest-VolumesSnapshotTestJSON-1430329829 None] Create snapshot completed successfully Nov 03 07:31:42 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Flow 'volume_create_manager' (980db017-1b38-41f2-8f7a-30cc535d6bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4f2b23-2303-44a6-8a2e-a3c5ba1c53da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4f2b23-2303-44a6-8a2e-a3c5ba1c53da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-153855063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d98d490-9751-48ae-962f-0b102f0df0dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='168ec788a5d340e58e2c29924be85da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:43Z,use_quota=True,user_id='9c5e0321d7bf47b3af3a63e1ce5ebc99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca15064b-9a8f-4af7-b6de-6ed055493477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca15064b-9a8f-4af7-b6de-6ed055493477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f6d674-c2a9-47ec-896f-f933c3195587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f6d674-c2a9-47ec-896f-f933c3195587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d98d490-9751-48ae-962f-0b102f0df0dc', 'volume_name': 'volume-3d98d490-9751-48ae-962f-0b102f0df0dc', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2535db-0489-4dc2-955f-4077dd58756d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2535db-0489-4dc2-955f-4077dd58756d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79caf32b-7cf3-4860-bdf7-5bcfb86f483e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:43 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Volume 3d98d490-9751-48ae-962f-0b102f0df0dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d98d490-9751-48ae-962f-0b102f0df0dc', 'volume_size': 1} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-153855063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d98d490-9751-48ae-962f-0b102f0df0dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='168ec788a5d340e58e2c29924be85da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:43Z,use_quota=True,user_id='9c5e0321d7bf47b3af3a63e1ce5ebc99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Creating volume 3d98d490-9751-48ae-962f-0b102f0df0dc {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:31:43 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3d98d490-9751-48ae-962f-0b102f0df0dc 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:31:43 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3d98d490-9751-48ae-962f-0b102f0df0dc 1073741824 Nov 03 07:31:43 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Flow 'volume_create_manager' (3d9aa2b7-d979-42ca-8b44-d1ea96be53d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f657eb05-69ac-4f75-a5a4-b062cc2139d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f657eb05-69ac-4f75-a5a4-b062cc2139d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1242551696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b5b670-e4ec-49db-875d-170e3060a6f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef528b9df2274d4096e2f40b55543323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=be957f08-5864-4a38-9253-587b52363f3a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:43Z,use_quota=True,user_id='e15721895a724e67be53f59d2b84d68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c747b5e6-7f6e-4b3b-b6cb-381e079a0c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c747b5e6-7f6e-4b3b-b6cb-381e079a0c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df07707e-7521-45ae-874d-3059e245ea92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df07707e-7521-45ae-874d-3059e245ea92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '77b5b670-e4ec-49db-875d-170e3060a6f7', 'volume_name': 'volume-77b5b670-e4ec-49db-875d-170e3060a6f7', 'volume_size': 1, 'snapshot_id': 'be957f08-5864-4a38-9253-587b52363f3a'}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b21210-af85-44c9-b22b-66819fd5acd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b21210-af85-44c9-b22b-66819fd5acd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b0e77b2-1c0e-471c-9c45-05cb7fa7611e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:43 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Volume 77b5b670-e4ec-49db-875d-170e3060a6f7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-77b5b670-e4ec-49db-875d-170e3060a6f7', 'volume_size': 1, 'snapshot_id': 'be957f08-5864-4a38-9253-587b52363f3a'} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:43 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3d98d490-9751-48ae-962f-0b102f0df0dc 1073741824" returned: 0 in 0.566s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3d98d490-9751-48ae-962f-0b102f0df0dc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:43 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3d98d490-9751-48ae-962f-0b102f0df0dc Nov 03 07:31:43 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:44 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3d98d490-9751-48ae-962f-0b102f0df0dc" returned: 0 in 0.287s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.722s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "cinder-quobyte-be957f08-5864-4a38-9253-587b52363f3a-77b5b670-e4ec-49db-875d-170e3060a6f7" by "_create_volume_from_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79caf32b-7cf3-4860-bdf7-5bcfb86f483e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d98d490-9751-48ae-962f-0b102f0df0dc', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c945a43-065d-4ee2-bc14-ae271924ea07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-be957f08-5864-4a38-9253-587b52363f3a-77b5b670-e4ec-49db-875d-170e3060a6f7" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Creating volume 77b5b670-e4ec-49db-875d-170e3060a6f7 from snapshot be957f08-5864-4a38-9253-587b52363f3a {{(pid=87016) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "cinder-quobyte-77b5b670-e4ec-49db-875d-170e3060a6f7" by "_copy_volume_from_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:44 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Volume volume-3d98d490-9751-48ae-962f-0b102f0df0dc (3d98d490-9751-48ae-962f-0b102f0df0dc): created successfully Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c945a43-065d-4ee2-bc14-ae271924ea07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Flow 'volume_create_manager' (980db017-1b38-41f2-8f7a-30cc535d6bd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-77b5b670-e4ec-49db-875d-170e3060a6f7" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] snapshot: be957f08-5864-4a38-9253-587b52363f3a, volume: 77b5b670-e4ec-49db-875d-170e3060a6f7, {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:31:44 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-e72fb528-cecf-40c7-a477-f7537d14d4e8 tempest-VolumesTestJSON-525760925 None] Created volume successfully. Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb420b9-7a9b-40fa-9023-904eec33b57a]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.be957f08-5864-4a38-9253-587b52363f3a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:44 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.be957f08-5864-4a38-9253-587b52363f3a Nov 03 07:31:44 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:44 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.be957f08-5864-4a38-9253-587b52363f3a" returned: 0 in 0.522s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[f549928d-4d8e-4a17-932a-23a2ed92db7a]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:44 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b Nov 03 07:31:44 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:45 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b" returned: 0 in 0.531s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:45 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:31:45 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Creating direct copy from snapshot {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:31:45 devstack cinder-volume[87016]: DEBUG cinder.utils [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Path /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77b5b670-e4ec-49db-875d-170e3060a6f7 not found in is_blk_device check {{(pid=87016) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 07:31:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77b5b670-e4ec-49db-875d-170e3060a6f7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:45 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77b5b670-e4ec-49db-875d-170e3060a6f7 Nov 03 07:31:45 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:45 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=120,cinder:UPDATE=123,cinder:DELETE=14,cinder:INSERT=34 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:31:45 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:UPDATE=127,cinder:SELECT=139,cinder:INSERT=30,cinder:DELETE=8 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:31:45 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:31:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Flow 'volume_create_manager' (65721701-8fba-4f18-a55f-02b280fc795f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c10de853-de33-41d6-a08e-23e096f831f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c10de853-de33-41d6-a08e-23e096f831f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-894089646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fcdb8f-b220-46c0-99dd-770f7adb2614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a81e786f8aed4497888408ad38e82be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:46Z,use_quota=True,user_id='5d78d27a9ccb4d0db4d513a11a1c9229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3271d771-c7dd-48a1-ad55-60583d1caca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3271d771-c7dd-48a1-ad55-60583d1caca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee8790f-ce0c-4d30-8479-73d7f9fdd6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee8790f-ce0c-4d30-8479-73d7f9fdd6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79fcdb8f-b220-46c0-99dd-770f7adb2614', 'volume_name': 'volume-79fcdb8f-b220-46c0-99dd-770f7adb2614', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df6768a-9e83-4c6d-a2fc-eec1e61c3b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df6768a-9e83-4c6d-a2fc-eec1e61c3b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb560e52-00af-4712-a370-203632d444d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:45 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Volume 79fcdb8f-b220-46c0-99dd-770f7adb2614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79fcdb8f-b220-46c0-99dd-770f7adb2614', 'volume_size': 1} Nov 03 07:31:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:46 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:31:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Flow 'volume_create_manager' (9a47145e-f051-433a-8c41-dc81189c8141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fda144b-4744-4635-bbcb-d796743bb064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fda144b-4744-4635-bbcb-d796743bb064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1217293106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0af3e0-d5ff-4a54-93bf-3ac48356e898,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='168ec788a5d340e58e2c29924be85da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:46Z,use_quota=True,user_id='9c5e0321d7bf47b3af3a63e1ce5ebc99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504b96d6-4071-4419-b296-5460fc156eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504b96d6-4071-4419-b296-5460fc156eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9cbcefb-32ff-4ced-b058-c37b45d06041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9cbcefb-32ff-4ced-b058-c37b45d06041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b0af3e0-d5ff-4a54-93bf-3ac48356e898', 'volume_name': 'volume-7b0af3e0-d5ff-4a54-93bf-3ac48356e898', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e63798-2d74-4b07-9279-faa08c8456ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e63798-2d74-4b07-9279-faa08c8456ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7bb243-04b8-42b6-ad1b-ec550ad858e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:46 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Volume 7b0af3e0-d5ff-4a54-93bf-3ac48356e898: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b0af3e0-d5ff-4a54-93bf-3ac48356e898', 'volume_size': 1} Nov 03 07:31:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:31:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:49 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:31:49 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:49 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.464s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:31:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:31:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 28 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:31:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:31:53 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77b5b670-e4ec-49db-875d-170e3060a6f7" returned: 0 in 8.200s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:53 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Image conversion details: src /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b, size 1024.00 MB, duration 8.20 sec, destination /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77b5b670-e4ec-49db-875d-170e3060a6f7 {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:31:53 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Converted 1024.00 MB image at 124.86 MB/s Nov 03 07:31:53 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77b5b670-e4ec-49db-875d-170e3060a6f7 is being set with open permissions: ugo+rw Nov 03 07:31:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77b5b670-e4ec-49db-875d-170e3060a6f7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:53 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77b5b670-e4ec-49db-875d-170e3060a6f7 Nov 03 07:31:53 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:53 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77b5b670-e4ec-49db-875d-170e3060a6f7" returned: 0 in 0.280s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-77b5b670-e4ec-49db-875d-170e3060a6f7" released by "_copy_volume_from_snapshot" :: held 9.652s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-be957f08-5864-4a38-9253-587b52363f3a-77b5b670-e4ec-49db-875d-170e3060a6f7" released by "_create_volume_from_snapshot" :: held 9.765s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.800s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.847s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-894089646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fcdb8f-b220-46c0-99dd-770f7adb2614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a81e786f8aed4497888408ad38e82be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:46Z,use_quota=True,user_id='5d78d27a9ccb4d0db4d513a11a1c9229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:31:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Creating volume 79fcdb8f-b220-46c0-99dd-770f7adb2614 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:31:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:31:53 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:31:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79fcdb8f-b220-46c0-99dd-770f7adb2614 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b0e77b2-1c0e-471c-9c45-05cb7fa7611e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77b5b670-e4ec-49db-875d-170e3060a6f7', 'volume_size': 1, 'snapshot_id': 'be957f08-5864-4a38-9253-587b52363f3a'}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:53 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79fcdb8f-b220-46c0-99dd-770f7adb2614 1073741824 Nov 03 07:31:53 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22a9f220-b131-42b1-b2b2-ffff2c5aab4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:53 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Volume volume-77b5b670-e4ec-49db-875d-170e3060a6f7 (77b5b670-e4ec-49db-875d-170e3060a6f7): created successfully Nov 03 07:31:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22a9f220-b131-42b1-b2b2-ffff2c5aab4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Flow 'volume_create_manager' (3d9aa2b7-d979-42ca-8b44-d1ea96be53d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:53 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b943aec0-eb5e-4061-aae8-af43be76adc4 tempest-VolumesSnapshotTestJSON-1430329829 None] Created volume successfully. Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c6ac2fa5-c771-43af-8966-fbb5536e3117 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "cinder-77b5b670-e4ec-49db-875d-170e3060a6f7-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c6ac2fa5-c771-43af-8966-fbb5536e3117 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-77b5b670-e4ec-49db-875d-170e3060a6f7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c6ac2fa5-c771-43af-8966-fbb5536e3117 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "cinder-quobyte-77b5b670-e4ec-49db-875d-170e3060a6f7" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:54 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79fcdb8f-b220-46c0-99dd-770f7adb2614 1073741824" returned: 0 in 0.649s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c6ac2fa5-c771-43af-8966-fbb5536e3117 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-77b5b670-e4ec-49db-875d-170e3060a6f7" acquired by "delete_volume" :: waited 0.037s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[f610648c-ef8f-4914-94b4-4066f8fcb14b]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c6ac2fa5-c771-43af-8966-fbb5536e3117 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77b5b670-e4ec-49db-875d-170e3060a6f7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79fcdb8f-b220-46c0-99dd-770f7adb2614 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:54 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79fcdb8f-b220-46c0-99dd-770f7adb2614 Nov 03 07:31:54 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:54 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77b5b670-e4ec-49db-875d-170e3060a6f7 Nov 03 07:31:54 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:54 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79fcdb8f-b220-46c0-99dd-770f7adb2614" returned: 0 in 0.315s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.680s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1217293106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0af3e0-d5ff-4a54-93bf-3ac48356e898,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='168ec788a5d340e58e2c29924be85da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:46Z,use_quota=True,user_id='9c5e0321d7bf47b3af3a63e1ce5ebc99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Creating volume 7b0af3e0-d5ff-4a54-93bf-3ac48356e898 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:31:54 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b0af3e0-d5ff-4a54-93bf-3ac48356e898 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:54 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b0af3e0-d5ff-4a54-93bf-3ac48356e898 1073741824 Nov 03 07:31:54 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb560e52-00af-4712-a370-203632d444d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79fcdb8f-b220-46c0-99dd-770f7adb2614', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2051a58-2174-4fdc-a833-4e2ec371a374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:54 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Volume volume-79fcdb8f-b220-46c0-99dd-770f7adb2614 (79fcdb8f-b220-46c0-99dd-770f7adb2614): created successfully Nov 03 07:31:54 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2051a58-2174-4fdc-a833-4e2ec371a374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Flow 'volume_create_manager' (65721701-8fba-4f18-a55f-02b280fc795f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:55 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-d49a4cd0-078b-4418-a63f-1f505b99e7aa tempest-AttachVolumeShelveTestJSON-21019857 None] Created volume successfully. Nov 03 07:31:55 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c6ac2fa5-c771-43af-8966-fbb5536e3117 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77b5b670-e4ec-49db-875d-170e3060a6f7" returned: 0 in 0.476s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c6ac2fa5-c771-43af-8966-fbb5536e3117 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77b5b670-e4ec-49db-875d-170e3060a6f7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:55 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77b5b670-e4ec-49db-875d-170e3060a6f7 Nov 03 07:31:55 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:55 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c6ac2fa5-c771-43af-8966-fbb5536e3117 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77b5b670-e4ec-49db-875d-170e3060a6f7" returned: 0 in 0.323s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c6ac2fa5-c771-43af-8966-fbb5536e3117 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-77b5b670-e4ec-49db-875d-170e3060a6f7" released by "delete_volume" :: held 0.853s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-c6ac2fa5-c771-43af-8966-fbb5536e3117 tempest-VolumesSnapshotTestJSON-1430329829 None] Created reservations ['f3e26350-6de0-4cb7-83d5-9e0105b50410', 'abddae56-6d36-4aa1-9aaa-3d6f976aed09', 'e983a866-ef30-4a5f-a2df-b5a37810c8d3', '52698293-50a8-4296-a4ce-8b9265a3fdde'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:31:55 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b0af3e0-d5ff-4a54-93bf-3ac48356e898 1073741824" returned: 0 in 0.589s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c6ac2fa5-c771-43af-8966-fbb5536e3117 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c6ac2fa5-c771-43af-8966-fbb5536e3117 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-c6ac2fa5-c771-43af-8966-fbb5536e3117 tempest-VolumesSnapshotTestJSON-1430329829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-c6ac2fa5-c771-43af-8966-fbb5536e3117 tempest-VolumesSnapshotTestJSON-1430329829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c6ac2fa5-c771-43af-8966-fbb5536e3117 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c6ac2fa5-c771-43af-8966-fbb5536e3117 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b0af3e0-d5ff-4a54-93bf-3ac48356e898 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:55 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:31:55 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:55 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b0af3e0-d5ff-4a54-93bf-3ac48356e898 Nov 03 07:31:55 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6d23d8f4-1732-460c-a5c4-818299db260f tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "cinder-be957f08-5864-4a38-9253-587b52363f3a-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6d23d8f4-1732-460c-a5c4-818299db260f tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-be957f08-5864-4a38-9253-587b52363f3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6d23d8f4-1732-460c-a5c4-818299db260f tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "cinder-quobyte-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6d23d8f4-1732-460c-a5c4-818299db260f tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6d23d8f4-1732-460c-a5c4-818299db260f tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "cinder-quobyte-be957f08-5864-4a38-9253-587b52363f3a" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6d23d8f4-1732-460c-a5c4-818299db260f tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-be957f08-5864-4a38-9253-587b52363f3a" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-6d23d8f4-1732-460c-a5c4-818299db260f tempest-VolumesSnapshotTestJSON-1430329829 None] Deleting offline snapshot be957f08-5864-4a38-9253-587b52363f3a of volume 3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-6d23d8f4-1732-460c-a5c4-818299db260f tempest-VolumesSnapshotTestJSON-1430329829 None] snapshot_file for this snap is: volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.be957f08-5864-4a38-9253-587b52363f3a {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[60394666-decd-4173-9251-96681c5b95a5]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6d23d8f4-1732-460c-a5c4-818299db260f tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.be957f08-5864-4a38-9253-587b52363f3a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:55 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c6ac2fa5-c771-43af-8966-fbb5536e3117 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.429s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:55 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-c6ac2fa5-c771-43af-8966-fbb5536e3117 tempest-VolumesSnapshotTestJSON-1430329829 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:31:56 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:56 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-c6ac2fa5-c771-43af-8966-fbb5536e3117 tempest-VolumesSnapshotTestJSON-1430329829 None] Deleted volume successfully. Nov 03 07:31:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b0af3e0-d5ff-4a54-93bf-3ac48356e898" returned: 0 in 0.451s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:31:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7bb243-04b8-42b6-ad1b-ec550ad858e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b0af3e0-d5ff-4a54-93bf-3ac48356e898', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7eb338b-9ad4-431c-a75d-56b021c8f397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:56 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.be957f08-5864-4a38-9253-587b52363f3a Nov 03 07:31:56 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c6ac2fa5-c771-43af-8966-fbb5536e3117 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-77b5b670-e4ec-49db-875d-170e3060a6f7-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:56 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:56 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Volume volume-7b0af3e0-d5ff-4a54-93bf-3ac48356e898 (7b0af3e0-d5ff-4a54-93bf-3ac48356e898): created successfully Nov 03 07:31:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7eb338b-9ad4-431c-a75d-56b021c8f397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Flow 'volume_create_manager' (9a47145e-f051-433a-8c41-dc81189c8141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:56 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-00faeaf1-2039-4abc-968c-aada0f3a050f tempest-VolumesTestJSON-525760925 None] Created volume successfully. Nov 03 07:31:56 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6d23d8f4-1732-460c-a5c4-818299db260f tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.be957f08-5864-4a38-9253-587b52363f3a" returned: 0 in 0.509s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-6d23d8f4-1732-460c-a5c4-818299db260f tempest-VolumesSnapshotTestJSON-1430329829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:31:56 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5526ae-3120-4147-87a7-fbe44dc71582]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6d23d8f4-1732-460c-a5c4-818299db260f tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:56 devstack sudo[97195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b Nov 03 07:31:56 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:57 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6d23d8f4-1732-460c-a5c4-818299db260f tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b" returned: 0 in 0.632s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6d23d8f4-1732-460c-a5c4-818299db260f tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.be957f08-5864-4a38-9253-587b52363f3a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:57 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.be957f08-5864-4a38-9253-587b52363f3a Nov 03 07:31:57 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:57 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6d23d8f4-1732-460c-a5c4-818299db260f tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.be957f08-5864-4a38-9253-587b52363f3a" returned: 0 in 0.729s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6d23d8f4-1732-460c-a5c4-818299db260f tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.be957f08-5864-4a38-9253-587b52363f3a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:57 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.be957f08-5864-4a38-9253-587b52363f3a Nov 03 07:31:57 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:58 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6d23d8f4-1732-460c-a5c4-818299db260f tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b.be957f08-5864-4a38-9253-587b52363f3a" returned: 0 in 0.398s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6d23d8f4-1732-460c-a5c4-818299db260f tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-be957f08-5864-4a38-9253-587b52363f3a" released by "_delete_snapshot" :: held 2.481s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6d23d8f4-1732-460c-a5c4-818299db260f tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b" released by "delete_snapshot" :: held 2.520s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Flow 'volume_create_manager' (c878da61-ece0-4c2f-a332-8e14e5d4bcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b72319d-fb80-46c7-aceb-72429ebc4d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b72319d-fb80-46c7-aceb-72429ebc4d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2096661993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc22f2ff-1cf5-465d-b137-7b219b950e24,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='168ec788a5d340e58e2c29924be85da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:58Z,use_quota=True,user_id='9c5e0321d7bf47b3af3a63e1ce5ebc99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b43a2b42-0aac-463e-9bc9-8ed0716bda7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b43a2b42-0aac-463e-9bc9-8ed0716bda7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6d5eaa-d92b-4695-858e-52dcda126039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6d5eaa-d92b-4695-858e-52dcda126039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc22f2ff-1cf5-465d-b137-7b219b950e24', 'volume_name': 'volume-bc22f2ff-1cf5-465d-b137-7b219b950e24', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bc8d2a-5d67-4020-85c0-4f68bb5fcc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bc8d2a-5d67-4020-85c0-4f68bb5fcc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4efc137-4dda-4987-b55f-efca140d75a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:58 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Volume bc22f2ff-1cf5-465d-b137-7b219b950e24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc22f2ff-1cf5-465d-b137-7b219b950e24', 'volume_size': 1} Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2096661993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc22f2ff-1cf5-465d-b137-7b219b950e24,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='168ec788a5d340e58e2c29924be85da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:58Z,use_quota=True,user_id='9c5e0321d7bf47b3af3a63e1ce5ebc99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Creating volume bc22f2ff-1cf5-465d-b137-7b219b950e24 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:31:58 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bc22f2ff-1cf5-465d-b137-7b219b950e24 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:58 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bc22f2ff-1cf5-465d-b137-7b219b950e24 1073741824 Nov 03 07:31:58 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-6d23d8f4-1732-460c-a5c4-818299db260f tempest-VolumesSnapshotTestJSON-1430329829 None] Created reservations ['ba8a463d-55d4-4101-a604-867029e05f34', '06bf5a5a-07ff-4840-97fa-f52c959279bc', '761bef54-c25e-4404-950a-ab3da619e1b1', '8f1780c4-842f-4cc7-ae9c-0e15fbbb07b7'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:31:58 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-6d23d8f4-1732-460c-a5c4-818299db260f tempest-VolumesSnapshotTestJSON-1430329829 None] Delete snapshot completed successfully. Nov 03 07:31:58 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6d23d8f4-1732-460c-a5c4-818299db260f tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-be957f08-5864-4a38-9253-587b52363f3a-delete_snapshot" released by "delete_snapshot" :: held 2.962s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:59 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bc22f2ff-1cf5-465d-b137-7b219b950e24 1073741824" returned: 0 in 0.742s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bc22f2ff-1cf5-465d-b137-7b219b950e24 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:59 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bc22f2ff-1cf5-465d-b137-7b219b950e24 Nov 03 07:31:59 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f24b1d58-f2ba-4632-a25a-517a3f69475d tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "cinder-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f24b1d58-f2ba-4632-a25a-517a3f69475d tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f24b1d58-f2ba-4632-a25a-517a3f69475d tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "cinder-quobyte-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f24b1d58-f2ba-4632-a25a-517a3f69475d tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b" acquired by "delete_volume" :: waited 0.035s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b954a9-f021-4f97-abe5-37ac625cf000]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f24b1d58-f2ba-4632-a25a-517a3f69475d tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Flow 'volume_create_manager' (eaa9daf6-a93a-4ea1-ba34-c9d6c5caff9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfedb2d3-2f60-4dad-9088-417ddf50cf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfedb2d3-2f60-4dad-9088-417ddf50cf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-245159809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b250294-5e86-429d-a94d-3d2b9c478dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c58c7e1bc04a1c8a10d5537cba35dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:59Z,use_quota=True,user_id='705f66239e284198adb708e79d959e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22eb1c59-3fd2-4289-868b-125cd3ba2c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:59 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22eb1c59-3fd2-4289-868b-125cd3ba2c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d95f9d-6e39-422b-a181-31281e59d090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d95f9d-6e39-422b-a181-31281e59d090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b250294-5e86-429d-a94d-3d2b9c478dd5', 'volume_name': 'volume-7b250294-5e86-429d-a94d-3d2b9c478dd5', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6fb2d72-5f30-467a-ba03-65e481fa476c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6fb2d72-5f30-467a-ba03-65e481fa476c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7365a5e8-7e50-4b01-8a5a-2908ff006ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:59 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Volume 7b250294-5e86-429d-a94d-3d2b9c478dd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b250294-5e86-429d-a94d-3d2b9c478dd5', 'volume_size': 1} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bc22f2ff-1cf5-465d-b137-7b219b950e24" returned: 0 in 0.465s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-245159809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b250294-5e86-429d-a94d-3d2b9c478dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c58c7e1bc04a1c8a10d5537cba35dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:59Z,use_quota=True,user_id='705f66239e284198adb708e79d959e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Creating volume 7b250294-5e86-429d-a94d-3d2b9c478dd5 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:31:59 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b250294-5e86-429d-a94d-3d2b9c478dd5 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:59 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b Nov 03 07:31:59 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:59 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b250294-5e86-429d-a94d-3d2b9c478dd5 1073741824 Nov 03 07:31:59 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4efc137-4dda-4987-b55f-efca140d75a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc22f2ff-1cf5-465d-b137-7b219b950e24', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b4f346-1e21-47a1-88d5-e076626b1de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:59 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Volume volume-bc22f2ff-1cf5-465d-b137-7b219b950e24 (bc22f2ff-1cf5-465d-b137-7b219b950e24): created successfully Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b4f346-1e21-47a1-88d5-e076626b1de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Flow 'volume_create_manager' (c878da61-ece0-4c2f-a332-8e14e5d4bcd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:59 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-402a1baf-79f2-46bc-bdb4-65e63c843878 tempest-VolumesTestJSON-525760925 None] Created volume successfully. Nov 03 07:32:00 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f24b1d58-f2ba-4632-a25a-517a3f69475d tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b" returned: 0 in 0.550s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f24b1d58-f2ba-4632-a25a-517a3f69475d tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:00 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b Nov 03 07:32:00 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:00 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b250294-5e86-429d-a94d-3d2b9c478dd5 1073741824" returned: 0 in 0.649s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b250294-5e86-429d-a94d-3d2b9c478dd5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:00 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b250294-5e86-429d-a94d-3d2b9c478dd5 Nov 03 07:32:00 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:00 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f24b1d58-f2ba-4632-a25a-517a3f69475d tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b" returned: 0 in 0.377s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f24b1d58-f2ba-4632-a25a-517a3f69475d tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b" released by "delete_volume" :: held 1.056s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:00 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-f24b1d58-f2ba-4632-a25a-517a3f69475d tempest-VolumesSnapshotTestJSON-1430329829 None] Created reservations ['57e1981c-4d36-4f43-bad8-d69fd6139af9', '2751c295-8ba4-4f70-9ab4-46043d04345c', '24f63e3b-a02e-422e-baa5-5c9aad34bf8b', '3c217305-79a9-443d-906f-e8de5d087cb3'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f24b1d58-f2ba-4632-a25a-517a3f69475d tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f24b1d58-f2ba-4632-a25a-517a3f69475d tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f24b1d58-f2ba-4632-a25a-517a3f69475d tempest-VolumesSnapshotTestJSON-1430329829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f24b1d58-f2ba-4632-a25a-517a3f69475d tempest-VolumesSnapshotTestJSON-1430329829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f24b1d58-f2ba-4632-a25a-517a3f69475d tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f24b1d58-f2ba-4632-a25a-517a3f69475d tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:00 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:32:00 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:00 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b250294-5e86-429d-a94d-3d2b9c478dd5" returned: 0 in 0.359s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:32:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:00 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7365a5e8-7e50-4b01-8a5a-2908ff006ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b250294-5e86-429d-a94d-3d2b9c478dd5', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:00 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006c825d-866c-4c32-a847-c898d0e04894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:00 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Volume volume-7b250294-5e86-429d-a94d-3d2b9c478dd5 (7b250294-5e86-429d-a94d-3d2b9c478dd5): created successfully Nov 03 07:32:00 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006c825d-866c-4c32-a847-c898d0e04894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:00 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Flow 'volume_create_manager' (eaa9daf6-a93a-4ea1-ba34-c9d6c5caff9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:00 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-6fcc308d-895a-4629-b8fd-6045f8dc81ec tempest-VolumeQuotasAdminTestJSON-1816197453 None] Created volume successfully. Nov 03 07:32:01 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f24b1d58-f2ba-4632-a25a-517a3f69475d tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.393s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:01 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-f24b1d58-f2ba-4632-a25a-517a3f69475d tempest-VolumesSnapshotTestJSON-1430329829 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:01 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-f24b1d58-f2ba-4632-a25a-517a3f69475d tempest-VolumesSnapshotTestJSON-1430329829 None] Deleted volume successfully. Nov 03 07:32:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f24b1d58-f2ba-4632-a25a-517a3f69475d tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-3aba4cd1-f277-4fcd-9c4f-e67f7ce1d41b-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-647bcd0e-9100-4d09-bc37-f8dc3eea8404 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Acquiring lock "cinder-7b250294-5e86-429d-a94d-3d2b9c478dd5-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-647bcd0e-9100-4d09-bc37-f8dc3eea8404 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Lock "cinder-7b250294-5e86-429d-a94d-3d2b9c478dd5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-647bcd0e-9100-4d09-bc37-f8dc3eea8404 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Acquiring lock "cinder-quobyte-7b250294-5e86-429d-a94d-3d2b9c478dd5" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-647bcd0e-9100-4d09-bc37-f8dc3eea8404 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Lock "cinder-quobyte-7b250294-5e86-429d-a94d-3d2b9c478dd5" acquired by "delete_volume" :: waited 0.025s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:01 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[7456f644-e055-4934-a486-f122afa636aa]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-647bcd0e-9100-4d09-bc37-f8dc3eea8404 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b250294-5e86-429d-a94d-3d2b9c478dd5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-093b18d1-2a0e-4fb1-9dc7-6d49ed40af11 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "cinder-40f03e80-e58f-4517-8e18-b15f46d370ea-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bb43970c-0341-4f26-95c0-5a564f34b11f tempest-VolumesTestJSON-525760925 None] Acquiring lock "cinder-bc22f2ff-1cf5-465d-b137-7b219b950e24-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-093b18d1-2a0e-4fb1-9dc7-6d49ed40af11 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-40f03e80-e58f-4517-8e18-b15f46d370ea-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bb43970c-0341-4f26-95c0-5a564f34b11f tempest-VolumesTestJSON-525760925 None] Lock "cinder-bc22f2ff-1cf5-465d-b137-7b219b950e24-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:01 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b250294-5e86-429d-a94d-3d2b9c478dd5 Nov 03 07:32:01 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-093b18d1-2a0e-4fb1-9dc7-6d49ed40af11 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "cinder-quobyte-40f03e80-e58f-4517-8e18-b15f46d370ea" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bb43970c-0341-4f26-95c0-5a564f34b11f tempest-VolumesTestJSON-525760925 None] Acquiring lock "cinder-quobyte-bc22f2ff-1cf5-465d-b137-7b219b950e24" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-093b18d1-2a0e-4fb1-9dc7-6d49ed40af11 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-40f03e80-e58f-4517-8e18-b15f46d370ea" acquired by "delete_volume" :: waited 0.038s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:02 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bb43970c-0341-4f26-95c0-5a564f34b11f tempest-VolumesTestJSON-525760925 None] Lock "cinder-quobyte-bc22f2ff-1cf5-465d-b137-7b219b950e24" acquired by "delete_volume" :: waited 0.101s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:02 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[144f2140-681d-43a9-bc7e-a06f08e4635f]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-093b18d1-2a0e-4fb1-9dc7-6d49ed40af11 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:02 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09d45e2-3d84-431d-80b3-db4383280731]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bb43970c-0341-4f26-95c0-5a564f34b11f tempest-VolumesTestJSON-525760925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bc22f2ff-1cf5-465d-b137-7b219b950e24 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:02 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea Nov 03 07:32:02 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:02 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bc22f2ff-1cf5-465d-b137-7b219b950e24 Nov 03 07:32:02 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:02 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-647bcd0e-9100-4d09-bc37-f8dc3eea8404 tempest-VolumeQuotasAdminTestJSON-1816197453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b250294-5e86-429d-a94d-3d2b9c478dd5" returned: 0 in 0.683s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-647bcd0e-9100-4d09-bc37-f8dc3eea8404 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b250294-5e86-429d-a94d-3d2b9c478dd5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:02 devstack sudo[97261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b250294-5e86-429d-a94d-3d2b9c478dd5 Nov 03 07:32:02 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:02 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-647bcd0e-9100-4d09-bc37-f8dc3eea8404 tempest-VolumeQuotasAdminTestJSON-1816197453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b250294-5e86-429d-a94d-3d2b9c478dd5" returned: 0 in 0.368s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:02 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-647bcd0e-9100-4d09-bc37-f8dc3eea8404 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Lock "cinder-quobyte-7b250294-5e86-429d-a94d-3d2b9c478dd5" released by "delete_volume" :: held 1.126s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:02 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-093b18d1-2a0e-4fb1-9dc7-6d49ed40af11 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea" returned: 0 in 0.676s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-093b18d1-2a0e-4fb1-9dc7-6d49ed40af11 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:02 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea Nov 03 07:32:02 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:02 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-647bcd0e-9100-4d09-bc37-f8dc3eea8404 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Created reservations ['845fb5cf-8b46-4b42-b1f1-275ed24afce9', '592ed5a9-84cd-4d08-93cb-51eea7076f17', '059a1724-0623-4af9-a921-0e79988c0ec6', '236807e2-c191-4ac5-ab57-076d2385b842'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:02 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bb43970c-0341-4f26-95c0-5a564f34b11f tempest-VolumesTestJSON-525760925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bc22f2ff-1cf5-465d-b137-7b219b950e24" returned: 0 in 0.746s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bb43970c-0341-4f26-95c0-5a564f34b11f tempest-VolumesTestJSON-525760925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bc22f2ff-1cf5-465d-b137-7b219b950e24 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:02 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bc22f2ff-1cf5-465d-b137-7b219b950e24 Nov 03 07:32:02 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-647bcd0e-9100-4d09-bc37-f8dc3eea8404 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-647bcd0e-9100-4d09-bc37-f8dc3eea8404 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:02 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-647bcd0e-9100-4d09-bc37-f8dc3eea8404 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-647bcd0e-9100-4d09-bc37-f8dc3eea8404 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-647bcd0e-9100-4d09-bc37-f8dc3eea8404 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-647bcd0e-9100-4d09-bc37-f8dc3eea8404 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:03 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:32:03 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:03 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-093b18d1-2a0e-4fb1-9dc7-6d49ed40af11 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-40f03e80-e58f-4517-8e18-b15f46d370ea" returned: 0 in 0.443s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-093b18d1-2a0e-4fb1-9dc7-6d49ed40af11 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-quobyte-40f03e80-e58f-4517-8e18-b15f46d370ea" released by "delete_volume" :: held 1.267s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-093b18d1-2a0e-4fb1-9dc7-6d49ed40af11 tempest-VolumesSnapshotTestJSON-1430329829 None] Created reservations ['8d42259e-03b3-4b12-8d0c-845dac9924cd', '1b3cc3d3-f4a8-4113-83c7-e6c5cecbbd27', '8c84be89-7fcf-4691-8204-1eebce5bfe9b', 'd2a1ea7e-7ef4-47f3-8267-7c3eb7f1010d'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:03 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bb43970c-0341-4f26-95c0-5a564f34b11f tempest-VolumesTestJSON-525760925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bc22f2ff-1cf5-465d-b137-7b219b950e24" returned: 0 in 0.507s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:03 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-647bcd0e-9100-4d09-bc37-f8dc3eea8404 tempest-VolumeQuotasAdminTestJSON-1816197453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.405s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-647bcd0e-9100-4d09-bc37-f8dc3eea8404 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bb43970c-0341-4f26-95c0-5a564f34b11f tempest-VolumesTestJSON-525760925 None] Lock "cinder-quobyte-bc22f2ff-1cf5-465d-b137-7b219b950e24" released by "delete_volume" :: held 1.339s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:03 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-647bcd0e-9100-4d09-bc37-f8dc3eea8404 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Deleted volume successfully. Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-093b18d1-2a0e-4fb1-9dc7-6d49ed40af11 tempest-VolumesSnapshotTestJSON-1430329829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-093b18d1-2a0e-4fb1-9dc7-6d49ed40af11 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-093b18d1-2a0e-4fb1-9dc7-6d49ed40af11 tempest-VolumesSnapshotTestJSON-1430329829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-093b18d1-2a0e-4fb1-9dc7-6d49ed40af11 tempest-VolumesSnapshotTestJSON-1430329829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-093b18d1-2a0e-4fb1-9dc7-6d49ed40af11 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-093b18d1-2a0e-4fb1-9dc7-6d49ed40af11 tempest-VolumesSnapshotTestJSON-1430329829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-647bcd0e-9100-4d09-bc37-f8dc3eea8404 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Lock "cinder-7b250294-5e86-429d-a94d-3d2b9c478dd5-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:03 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:32:03 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-bb43970c-0341-4f26-95c0-5a564f34b11f tempest-VolumesTestJSON-525760925 None] Created reservations ['daddeea4-b391-4f32-b47c-3929c3face99', 'f12b2d25-639f-44b2-8365-b2e71a22eda1', '5c5752e9-0ee4-48fe-bd89-96d4374d58ab', 'd5e06627-615a-441a-aad3-7ae9163a225b'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-bb43970c-0341-4f26-95c0-5a564f34b11f tempest-VolumesTestJSON-525760925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-bb43970c-0341-4f26-95c0-5a564f34b11f tempest-VolumesTestJSON-525760925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-bb43970c-0341-4f26-95c0-5a564f34b11f tempest-VolumesTestJSON-525760925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-bb43970c-0341-4f26-95c0-5a564f34b11f tempest-VolumesTestJSON-525760925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-bb43970c-0341-4f26-95c0-5a564f34b11f tempest-VolumesTestJSON-525760925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bb43970c-0341-4f26-95c0-5a564f34b11f tempest-VolumesTestJSON-525760925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:03 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:32:03 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:03 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-093b18d1-2a0e-4fb1-9dc7-6d49ed40af11 tempest-VolumesSnapshotTestJSON-1430329829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.475s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-093b18d1-2a0e-4fb1-9dc7-6d49ed40af11 tempest-VolumesSnapshotTestJSON-1430329829 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:03 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-093b18d1-2a0e-4fb1-9dc7-6d49ed40af11 tempest-VolumesSnapshotTestJSON-1430329829 None] Deleted volume successfully. Nov 03 07:32:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-093b18d1-2a0e-4fb1-9dc7-6d49ed40af11 tempest-VolumesSnapshotTestJSON-1430329829 None] Lock "cinder-40f03e80-e58f-4517-8e18-b15f46d370ea-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:04 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bb43970c-0341-4f26-95c0-5a564f34b11f tempest-VolumesTestJSON-525760925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.367s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-bb43970c-0341-4f26-95c0-5a564f34b11f tempest-VolumesTestJSON-525760925 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:04 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-bb43970c-0341-4f26-95c0-5a564f34b11f tempest-VolumesTestJSON-525760925 None] Deleted volume successfully. Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bb43970c-0341-4f26-95c0-5a564f34b11f tempest-VolumesTestJSON-525760925 None] Lock "cinder-bc22f2ff-1cf5-465d-b137-7b219b950e24-delete_volume" released by "delete_volume" :: held 2.188s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-16a78488-29ee-4ac3-980e-065abe214ecd tempest-VolumesTestJSON-525760925 None] Acquiring lock "cinder-7b0af3e0-d5ff-4a54-93bf-3ac48356e898-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-16a78488-29ee-4ac3-980e-065abe214ecd tempest-VolumesTestJSON-525760925 None] Lock "cinder-7b0af3e0-d5ff-4a54-93bf-3ac48356e898-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-16a78488-29ee-4ac3-980e-065abe214ecd tempest-VolumesTestJSON-525760925 None] Acquiring lock "cinder-quobyte-7b0af3e0-d5ff-4a54-93bf-3ac48356e898" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-16a78488-29ee-4ac3-980e-065abe214ecd tempest-VolumesTestJSON-525760925 None] Lock "cinder-quobyte-7b0af3e0-d5ff-4a54-93bf-3ac48356e898" acquired by "delete_volume" :: waited 0.037s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ddf297-d490-4037-8493-50db8023726b]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-16a78488-29ee-4ac3-980e-065abe214ecd tempest-VolumesTestJSON-525760925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b0af3e0-d5ff-4a54-93bf-3ac48356e898 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:04 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b0af3e0-d5ff-4a54-93bf-3ac48356e898 Nov 03 07:32:04 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Flow 'volume_create_manager' (a114a155-f5a7-44b4-934c-0c33c5bb7e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8730ef-3a2d-48d1-acd8-b63827316984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8730ef-3a2d-48d1-acd8-b63827316984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1840150872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4997d0cc-b40f-4e4d-acd7-9cb2a47b809c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c58c7e1bc04a1c8a10d5537cba35dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:05Z,use_quota=True,user_id='705f66239e284198adb708e79d959e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (604025f5-c67e-49a4-b902-630f41279d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (604025f5-c67e-49a4-b902-630f41279d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0dd16ed-1cb4-4e8f-8917-22bf4f218c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0dd16ed-1cb4-4e8f-8917-22bf4f218c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4997d0cc-b40f-4e4d-acd7-9cb2a47b809c', 'volume_name': 'volume-4997d0cc-b40f-4e4d-acd7-9cb2a47b809c', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4583b6-93d7-4a62-96c5-bbe2bda41289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4583b6-93d7-4a62-96c5-bbe2bda41289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b41acb4-6ba5-4c7c-8435-093305386942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:04 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Volume 4997d0cc-b40f-4e4d-acd7-9cb2a47b809c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4997d0cc-b40f-4e4d-acd7-9cb2a47b809c', 'volume_size': 1} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1840150872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4997d0cc-b40f-4e4d-acd7-9cb2a47b809c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c58c7e1bc04a1c8a10d5537cba35dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:05Z,use_quota=True,user_id='705f66239e284198adb708e79d959e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Creating volume 4997d0cc-b40f-4e4d-acd7-9cb2a47b809c {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:32:04 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:32:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4997d0cc-b40f-4e4d-acd7-9cb2a47b809c 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:04 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4997d0cc-b40f-4e4d-acd7-9cb2a47b809c 1073741824 Nov 03 07:32:04 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:05 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-16a78488-29ee-4ac3-980e-065abe214ecd tempest-VolumesTestJSON-525760925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b0af3e0-d5ff-4a54-93bf-3ac48356e898" returned: 0 in 0.554s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-16a78488-29ee-4ac3-980e-065abe214ecd tempest-VolumesTestJSON-525760925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b0af3e0-d5ff-4a54-93bf-3ac48356e898 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:05 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b0af3e0-d5ff-4a54-93bf-3ac48356e898 Nov 03 07:32:05 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:05 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-16a78488-29ee-4ac3-980e-065abe214ecd tempest-VolumesTestJSON-525760925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b0af3e0-d5ff-4a54-93bf-3ac48356e898" returned: 0 in 0.387s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-16a78488-29ee-4ac3-980e-065abe214ecd tempest-VolumesTestJSON-525760925 None] Lock "cinder-quobyte-7b0af3e0-d5ff-4a54-93bf-3ac48356e898" released by "delete_volume" :: held 1.032s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:05 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:05 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-16a78488-29ee-4ac3-980e-065abe214ecd tempest-VolumesTestJSON-525760925 None] Created reservations ['be890b77-7054-4e1d-ae7d-95324a5883d5', '08c68e67-7758-4827-ab43-66aa6f9306af', '6e1302ea-5c3a-4bbe-8261-757a09998127', '6cdbd07a-3175-4315-b7d3-283bd8e998d2'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4997d0cc-b40f-4e4d-acd7-9cb2a47b809c 1073741824" returned: 0 in 0.808s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4997d0cc-b40f-4e4d-acd7-9cb2a47b809c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:05 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4997d0cc-b40f-4e4d-acd7-9cb2a47b809c Nov 03 07:32:05 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-16a78488-29ee-4ac3-980e-065abe214ecd tempest-VolumesTestJSON-525760925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-16a78488-29ee-4ac3-980e-065abe214ecd tempest-VolumesTestJSON-525760925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-16a78488-29ee-4ac3-980e-065abe214ecd tempest-VolumesTestJSON-525760925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-16a78488-29ee-4ac3-980e-065abe214ecd tempest-VolumesTestJSON-525760925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-16a78488-29ee-4ac3-980e-065abe214ecd tempest-VolumesTestJSON-525760925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-16a78488-29ee-4ac3-980e-065abe214ecd tempest-VolumesTestJSON-525760925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:05 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:32:05 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:06 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-16a78488-29ee-4ac3-980e-065abe214ecd tempest-VolumesTestJSON-525760925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.384s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:06 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:06 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-16a78488-29ee-4ac3-980e-065abe214ecd tempest-VolumesTestJSON-525760925 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4997d0cc-b40f-4e4d-acd7-9cb2a47b809c" returned: 0 in 0.470s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:06 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:32:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:06 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-16a78488-29ee-4ac3-980e-065abe214ecd tempest-VolumesTestJSON-525760925 None] Deleted volume successfully. Nov 03 07:32:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b41acb4-6ba5-4c7c-8435-093305386942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4997d0cc-b40f-4e4d-acd7-9cb2a47b809c', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333c20ec-f45e-472e-9f81-c893d2e346cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:06 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-16a78488-29ee-4ac3-980e-065abe214ecd tempest-VolumesTestJSON-525760925 None] Lock "cinder-7b0af3e0-d5ff-4a54-93bf-3ac48356e898-delete_volume" released by "delete_volume" :: held 1.994s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:06 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Volume volume-4997d0cc-b40f-4e4d-acd7-9cb2a47b809c (4997d0cc-b40f-4e4d-acd7-9cb2a47b809c): created successfully Nov 03 07:32:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333c20ec-f45e-472e-9f81-c893d2e346cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Flow 'volume_create_manager' (a114a155-f5a7-44b4-934c-0c33c5bb7e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:06 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-268001e1-f372-42ed-97d2-2ff464b99269 tempest-VolumeQuotasAdminTestJSON-1816197453 None] Created volume successfully. Nov 03 07:32:06 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-43618552-dbfb-4029-a1f2-882f417e5016 tempest-VolumesTestJSON-525760925 None] Acquiring lock "cinder-3d98d490-9751-48ae-962f-0b102f0df0dc-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:06 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-43618552-dbfb-4029-a1f2-882f417e5016 tempest-VolumesTestJSON-525760925 None] Lock "cinder-3d98d490-9751-48ae-962f-0b102f0df0dc-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:06 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-43618552-dbfb-4029-a1f2-882f417e5016 tempest-VolumesTestJSON-525760925 None] Acquiring lock "cinder-quobyte-3d98d490-9751-48ae-962f-0b102f0df0dc" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:06 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-43618552-dbfb-4029-a1f2-882f417e5016 tempest-VolumesTestJSON-525760925 None] Lock "cinder-quobyte-3d98d490-9751-48ae-962f-0b102f0df0dc" acquired by "delete_volume" :: waited 0.028s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:06 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb497369-b0f4-4699-909a-9924caa6cde8]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-43618552-dbfb-4029-a1f2-882f417e5016 tempest-VolumesTestJSON-525760925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3d98d490-9751-48ae-962f-0b102f0df0dc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:07 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3d98d490-9751-48ae-962f-0b102f0df0dc Nov 03 07:32:07 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:07 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-43618552-dbfb-4029-a1f2-882f417e5016 tempest-VolumesTestJSON-525760925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3d98d490-9751-48ae-962f-0b102f0df0dc" returned: 0 in 0.522s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-43618552-dbfb-4029-a1f2-882f417e5016 tempest-VolumesTestJSON-525760925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3d98d490-9751-48ae-962f-0b102f0df0dc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:07 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3d98d490-9751-48ae-962f-0b102f0df0dc Nov 03 07:32:07 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:07 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-43618552-dbfb-4029-a1f2-882f417e5016 tempest-VolumesTestJSON-525760925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3d98d490-9751-48ae-962f-0b102f0df0dc" returned: 0 in 0.353s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:07 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-43618552-dbfb-4029-a1f2-882f417e5016 tempest-VolumesTestJSON-525760925 None] Lock "cinder-quobyte-3d98d490-9751-48ae-962f-0b102f0df0dc" released by "delete_volume" :: held 0.959s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:07 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-18271e30-ffc5-4a4f-b943-f7209b6c8241 tempest-VolumeQuotasAdminTestJSON-1045335145 None] Transfer volume completed successfully. Nov 03 07:32:07 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-43618552-dbfb-4029-a1f2-882f417e5016 tempest-VolumesTestJSON-525760925 None] Created reservations ['9ed9e1fe-7a43-45ae-89f6-480014eed5bf', '559a3894-8f74-4912-9718-3054be71e318', 'd0ce52a9-dc64-4c9f-b871-860a2895b7c3', '7ab7a2cf-9db2-4308-a46e-448aee02bc8e'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-43618552-dbfb-4029-a1f2-882f417e5016 tempest-VolumesTestJSON-525760925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-43618552-dbfb-4029-a1f2-882f417e5016 tempest-VolumesTestJSON-525760925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-43618552-dbfb-4029-a1f2-882f417e5016 tempest-VolumesTestJSON-525760925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-43618552-dbfb-4029-a1f2-882f417e5016 tempest-VolumesTestJSON-525760925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-43618552-dbfb-4029-a1f2-882f417e5016 tempest-VolumesTestJSON-525760925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-43618552-dbfb-4029-a1f2-882f417e5016 tempest-VolumesTestJSON-525760925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:08 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:32:08 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:08 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-43618552-dbfb-4029-a1f2-882f417e5016 tempest-VolumesTestJSON-525760925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.483s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:08 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-43618552-dbfb-4029-a1f2-882f417e5016 tempest-VolumesTestJSON-525760925 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:08 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-43618552-dbfb-4029-a1f2-882f417e5016 tempest-VolumesTestJSON-525760925 None] Deleted volume successfully. Nov 03 07:32:08 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-43618552-dbfb-4029-a1f2-882f417e5016 tempest-VolumesTestJSON-525760925 None] Lock "cinder-3d98d490-9751-48ae-962f-0b102f0df0dc-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:08 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ebdcc97b-f8db-43fa-b946-bebd12692843 tempest-VolumeQuotasAdminTestJSON-1115909545 None] Acquiring lock "cinder-4997d0cc-b40f-4e4d-acd7-9cb2a47b809c-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:08 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ebdcc97b-f8db-43fa-b946-bebd12692843 tempest-VolumeQuotasAdminTestJSON-1115909545 None] Lock "cinder-4997d0cc-b40f-4e4d-acd7-9cb2a47b809c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:08 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ebdcc97b-f8db-43fa-b946-bebd12692843 tempest-VolumeQuotasAdminTestJSON-1115909545 None] Acquiring lock "cinder-quobyte-4997d0cc-b40f-4e4d-acd7-9cb2a47b809c" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:08 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ebdcc97b-f8db-43fa-b946-bebd12692843 tempest-VolumeQuotasAdminTestJSON-1115909545 None] Lock "cinder-quobyte-4997d0cc-b40f-4e4d-acd7-9cb2a47b809c" acquired by "delete_volume" :: waited 0.021s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:08 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab913a7-64a1-4e72-80b8-d637836054fa]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ebdcc97b-f8db-43fa-b946-bebd12692843 tempest-VolumeQuotasAdminTestJSON-1115909545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4997d0cc-b40f-4e4d-acd7-9cb2a47b809c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-741966b8-c308-4370-b1f1-9dfda6cb0b2b req-8ca2da18-a4ee-4f9b-aa8f-89a657d57a65 tempest-AttachVolumeShelveTestJSON-21019857 None] No connector for attachment cf4d4d6f-219e-4137-9d74-f182d38f7dc4; skipping storage backend terminate_connection call. {{(pid=87016) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 03 07:32:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-741966b8-c308-4370-b1f1-9dfda6cb0b2b req-8ca2da18-a4ee-4f9b-aa8f-89a657d57a65 tempest-AttachVolumeShelveTestJSON-21019857 None] Deleting attachment cf4d4d6f-219e-4137-9d74-f182d38f7dc4. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:32:09 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4997d0cc-b40f-4e4d-acd7-9cb2a47b809c Nov 03 07:32:09 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:09 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ebdcc97b-f8db-43fa-b946-bebd12692843 tempest-VolumeQuotasAdminTestJSON-1115909545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4997d0cc-b40f-4e4d-acd7-9cb2a47b809c" returned: 0 in 0.595s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ebdcc97b-f8db-43fa-b946-bebd12692843 tempest-VolumeQuotasAdminTestJSON-1115909545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4997d0cc-b40f-4e4d-acd7-9cb2a47b809c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:09 devstack sudo[97345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4997d0cc-b40f-4e4d-acd7-9cb2a47b809c Nov 03 07:32:09 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:09 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ebdcc97b-f8db-43fa-b946-bebd12692843 tempest-VolumeQuotasAdminTestJSON-1115909545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4997d0cc-b40f-4e4d-acd7-9cb2a47b809c" returned: 0 in 0.393s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:09 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ebdcc97b-f8db-43fa-b946-bebd12692843 tempest-VolumeQuotasAdminTestJSON-1115909545 None] Lock "cinder-quobyte-4997d0cc-b40f-4e4d-acd7-9cb2a47b809c" released by "delete_volume" :: held 1.102s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:09 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-ebdcc97b-f8db-43fa-b946-bebd12692843 tempest-VolumeQuotasAdminTestJSON-1115909545 None] Created reservations ['49b2a079-26a4-4ffd-9754-ab5ef2b6d1d5', '3ba7d13d-1f72-41db-a741-56b47fcdd727', '34962b93-ecaf-4fde-b9f9-dc3f34bd9ab1', '210edc3f-ae5e-4218-86f1-e520f7e0ac43'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ebdcc97b-f8db-43fa-b946-bebd12692843 tempest-VolumeQuotasAdminTestJSON-1115909545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ebdcc97b-f8db-43fa-b946-bebd12692843 tempest-VolumeQuotasAdminTestJSON-1115909545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ebdcc97b-f8db-43fa-b946-bebd12692843 tempest-VolumeQuotasAdminTestJSON-1115909545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ebdcc97b-f8db-43fa-b946-bebd12692843 tempest-VolumeQuotasAdminTestJSON-1115909545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ebdcc97b-f8db-43fa-b946-bebd12692843 tempest-VolumeQuotasAdminTestJSON-1115909545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ebdcc97b-f8db-43fa-b946-bebd12692843 tempest-VolumeQuotasAdminTestJSON-1115909545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:10 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:32:10 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:10 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ebdcc97b-f8db-43fa-b946-bebd12692843 tempest-VolumeQuotasAdminTestJSON-1115909545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.388s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:10 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-ebdcc97b-f8db-43fa-b946-bebd12692843 tempest-VolumeQuotasAdminTestJSON-1115909545 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:10 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ebdcc97b-f8db-43fa-b946-bebd12692843 tempest-VolumeQuotasAdminTestJSON-1115909545 None] Deleted volume successfully. Nov 03 07:32:10 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ebdcc97b-f8db-43fa-b946-bebd12692843 tempest-VolumeQuotasAdminTestJSON-1115909545 None] Lock "cinder-4997d0cc-b40f-4e4d-acd7-9cb2a47b809c-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0b4ad6f9-430d-4d07-848b-e8b3b08927d7 tempest-BackendsCapabilitiesAdminTestsJSON-1212413604 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7531204223633, 'free_capacity_gb': 1773.7531204223633, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87016) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 07:32:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-072e92fc-2daf-4e58-bba0-bf4acf46fce5 tempest-BackendsCapabilitiesAdminTestsJSON-1212413604 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7531204223633, 'free_capacity_gb': 1773.7531204223633, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87016) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 07:32:19 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:32:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Flow 'volume_create_manager' (5c174106-bb00-4904-8ad2-057ae6844f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b0c32e8-6b01-4db2-88db-e85bffe419e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b0c32e8-6b01-4db2-88db-e85bffe419e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1668440910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e4a68d-8a83-4a08-a76c-3143db4cf7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593255b3e1e8455f9b5edc3b36836cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:19Z,use_quota=True,user_id='a2bafad8c8164f57b59bb0e83b3ad11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca330122-4b77-4345-a07f-de80fb90ae9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca330122-4b77-4345-a07f-de80fb90ae9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ae8a82-b382-47ae-9fd3-5fa6bd14cebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ae8a82-b382-47ae-9fd3-5fa6bd14cebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e4a68d-8a83-4a08-a76c-3143db4cf7b7', 'volume_name': 'volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f621e0-87cb-4a0a-b9a5-e17e0ffa6aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f621e0-87cb-4a0a-b9a5-e17e0ffa6aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82e1ef7-f770-45ee-af29-a06b6454aac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:19 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Volume b9e4a68d-8a83-4a08-a76c-3143db4cf7b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7', 'volume_size': 1} Nov 03 07:32:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1668440910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e4a68d-8a83-4a08-a76c-3143db4cf7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593255b3e1e8455f9b5edc3b36836cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:19Z,use_quota=True,user_id='a2bafad8c8164f57b59bb0e83b3ad11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:32:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Creating volume b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:32:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:32:19 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:32:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:19 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 1073741824 Nov 03 07:32:19 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:20 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 1073741824" returned: 0 in 0.676s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:20 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 Nov 03 07:32:20 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:20 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7" returned: 0 in 0.531s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:20 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:32:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:20 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82e1ef7-f770-45ee-af29-a06b6454aac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:20 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e68617-c22b-4a38-8af4-b64298a50c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:20 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Volume volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 (b9e4a68d-8a83-4a08-a76c-3143db4cf7b7): created successfully Nov 03 07:32:20 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e68617-c22b-4a38-8af4-b64298a50c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:20 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Flow 'volume_create_manager' (5c174106-bb00-4904-8ad2-057ae6844f44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:20 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-7346a0b5-f4d2-41e2-9bc6-51a96960c992 tempest-VolumesSnapshotListTestJSON-2047796889 None] Created volume successfully. Nov 03 07:32:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7a33801f-a7da-416d-a633-6b81c2e0cacf tempest-VolumesSnapshotListTestJSON-2047796889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7a33801f-a7da-416d-a633-6b81c2e0cacf tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:22 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-7a33801f-a7da-416d-a633-6b81c2e0cacf tempest-VolumesSnapshotListTestJSON-2047796889 None] Creating offline snapshot f9c96eb5-4e9b-44c0-ad01-d87abf4203bc of volume b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:32:22 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e98da08-b959-4278-80a5-4491888156ef]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7a33801f-a7da-416d-a633-6b81c2e0cacf tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:22 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 Nov 03 07:32:22 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:22 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7a33801f-a7da-416d-a633-6b81c2e0cacf tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7" returned: 0 in 0.733s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7a33801f-a7da-416d-a633-6b81c2e0cacf tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:22 devstack sudo[97447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc 1G Nov 03 07:32:22 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:23 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7a33801f-a7da-416d-a633-6b81c2e0cacf tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc 1G" returned: 0 in 0.897s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7a33801f-a7da-416d-a633-6b81c2e0cacf tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:23 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc Nov 03 07:32:23 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:24 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7a33801f-a7da-416d-a633-6b81c2e0cacf tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc" returned: 0 in 0.593s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:24 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-7a33801f-a7da-416d-a633-6b81c2e0cacf tempest-VolumesSnapshotListTestJSON-2047796889 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc is being set with open permissions: ugo+rw Nov 03 07:32:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7a33801f-a7da-416d-a633-6b81c2e0cacf tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:24 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc Nov 03 07:32:24 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:24 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7a33801f-a7da-416d-a633-6b81c2e0cacf tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc" returned: 0 in 0.391s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7a33801f-a7da-416d-a633-6b81c2e0cacf tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:24 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.info Nov 03 07:32:24 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:25 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7a33801f-a7da-416d-a633-6b81c2e0cacf tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.info" returned: 0 in 0.642s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:25 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-7a33801f-a7da-416d-a633-6b81c2e0cacf tempest-VolumesSnapshotListTestJSON-2047796889 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.info is being set with open permissions: ugo+rw Nov 03 07:32:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7a33801f-a7da-416d-a633-6b81c2e0cacf tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:25 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.info Nov 03 07:32:25 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:25 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7a33801f-a7da-416d-a633-6b81c2e0cacf tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.info" returned: 0 in 0.558s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7a33801f-a7da-416d-a633-6b81c2e0cacf tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.996s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:26 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-7a33801f-a7da-416d-a633-6b81c2e0cacf tempest-VolumesSnapshotListTestJSON-2047796889 None] Create snapshot completed successfully Nov 03 07:32:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-dee4a32a-303f-4231-9181-62bf9c6cac99 tempest-VolumesSnapshotListTestJSON-2047796889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-dee4a32a-303f-4231-9181-62bf9c6cac99 tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-dee4a32a-303f-4231-9181-62bf9c6cac99 tempest-VolumesSnapshotListTestJSON-2047796889 None] Creating offline snapshot 78f58875-ac6c-42f4-8e24-80f9fb8c08aa of volume b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:32:26 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d95dd8a-b654-442d-b1f1-8b51234a3909]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dee4a32a-303f-4231-9181-62bf9c6cac99 tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:26 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc Nov 03 07:32:27 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:27 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dee4a32a-303f-4231-9181-62bf9c6cac99 tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc" returned: 0 in 0.760s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-dee4a32a-303f-4231-9181-62bf9c6cac99 tempest-VolumesSnapshotListTestJSON-2047796889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:32:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dee4a32a-303f-4231-9181-62bf9c6cac99 tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:27 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:32:27 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa 1G Nov 03 07:32:27 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Flow 'volume_create_manager' (379ab419-5912-422d-807e-25ebd153a809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75476712-f0b4-4487-922c-ea3490619bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75476712-f0b4-4487-922c-ea3490619bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-548547323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5f2dea-8dbd-446e-a727-49485c08cd68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8c77125a9548a1b592d01e45f46526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:27Z,use_quota=True,user_id='060f1d8a1cb442d1b4ad022d90d22cbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb5b38b-4f93-4368-bd40-39849af13116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb5b38b-4f93-4368-bd40-39849af13116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3dc1219-5c23-48ad-9839-db57007dd4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3dc1219-5c23-48ad-9839-db57007dd4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b5f2dea-8dbd-446e-a727-49485c08cd68', 'volume_name': 'volume-3b5f2dea-8dbd-446e-a727-49485c08cd68', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a0c0b7-accc-44fa-9d7d-466bb3132181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a0c0b7-accc-44fa-9d7d-466bb3132181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f4f11f-e847-4715-97ca-55979d8c8689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:27 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Volume 3b5f2dea-8dbd-446e-a727-49485c08cd68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b5f2dea-8dbd-446e-a727-49485c08cd68', 'volume_size': 1} Nov 03 07:32:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:28 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dee4a32a-303f-4231-9181-62bf9c6cac99 tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa 1G" returned: 0 in 0.790s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dee4a32a-303f-4231-9181-62bf9c6cac99 tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:28 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa Nov 03 07:32:28 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:28 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dee4a32a-303f-4231-9181-62bf9c6cac99 tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa" returned: 0 in 0.435s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:28 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-dee4a32a-303f-4231-9181-62bf9c6cac99 tempest-VolumesSnapshotListTestJSON-2047796889 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa is being set with open permissions: ugo+rw Nov 03 07:32:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dee4a32a-303f-4231-9181-62bf9c6cac99 tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:28 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa Nov 03 07:32:28 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:29 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dee4a32a-303f-4231-9181-62bf9c6cac99 tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa" returned: 0 in 0.349s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-dee4a32a-303f-4231-9181-62bf9c6cac99 tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.533s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.452s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-548547323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5f2dea-8dbd-446e-a727-49485c08cd68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8c77125a9548a1b592d01e45f46526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:27Z,use_quota=True,user_id='060f1d8a1cb442d1b4ad022d90d22cbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:32:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Creating volume 3b5f2dea-8dbd-446e-a727-49485c08cd68 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:32:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:32:29 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:32:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3b5f2dea-8dbd-446e-a727-49485c08cd68 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:29 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3b5f2dea-8dbd-446e-a727-49485c08cd68 1073741824 Nov 03 07:32:29 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:29 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-dee4a32a-303f-4231-9181-62bf9c6cac99 tempest-VolumesSnapshotListTestJSON-2047796889 None] Create snapshot completed successfully Nov 03 07:32:29 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3b5f2dea-8dbd-446e-a727-49485c08cd68 1073741824" returned: 0 in 0.581s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3b5f2dea-8dbd-446e-a727-49485c08cd68 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:29 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3b5f2dea-8dbd-446e-a727-49485c08cd68 Nov 03 07:32:29 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a0c16d89-8d94-467f-993b-631df5ef6857 tempest-VolumesSnapshotListTestJSON-2047796889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:30 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3b5f2dea-8dbd-446e-a727-49485c08cd68" returned: 0 in 0.400s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:32:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a0c16d89-8d94-467f-993b-631df5ef6857 tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.047s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f4f11f-e847-4715-97ca-55979d8c8689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b5f2dea-8dbd-446e-a727-49485c08cd68', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9da4a2-1896-477f-bb35-fe92ae2b6015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-a0c16d89-8d94-467f-993b-631df5ef6857 tempest-VolumesSnapshotListTestJSON-2047796889 None] Creating offline snapshot a8148cce-3f49-486a-8eb2-c05f7880f2bd of volume b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:32:30 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Volume volume-3b5f2dea-8dbd-446e-a727-49485c08cd68 (3b5f2dea-8dbd-446e-a727-49485c08cd68): created successfully Nov 03 07:32:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9da4a2-1896-477f-bb35-fe92ae2b6015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Flow 'volume_create_manager' (379ab419-5912-422d-807e-25ebd153a809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:30 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1b9a9c-1980-4891-b966-4cf67ce9efe6]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0c16d89-8d94-467f-993b-631df5ef6857 tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:30 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-91c307a6-1be1-44d8-8099-34caacfd8489 tempest-VolumesServicesTestJSON-1566828560 None] Created volume successfully. Nov 03 07:32:30 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-bd700ce0-2081-434d-90dc-0801fa82757e tempest-GroupSnapshotsV319Test-1379001571 None] Group tempest-GroupSnapshotsV319Test-Group-500854932: creating Nov 03 07:32:30 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-bd700ce0-2081-434d-90dc-0801fa82757e tempest-GroupSnapshotsV319Test-1379001571 None] Group tempest-GroupSnapshotsV319Test-Group-500854932: created successfully Nov 03 07:32:30 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-bd700ce0-2081-434d-90dc-0801fa82757e tempest-GroupSnapshotsV319Test-1379001571 None] Create group completed successfully. Nov 03 07:32:30 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa Nov 03 07:32:30 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e9e1e675-406e-432a-92a3-c9fcb0dd5153 tempest-VolumesServicesTestJSON-1566828560 None] Acquiring lock "cinder-3b5f2dea-8dbd-446e-a727-49485c08cd68-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e9e1e675-406e-432a-92a3-c9fcb0dd5153 tempest-VolumesServicesTestJSON-1566828560 None] Lock "cinder-3b5f2dea-8dbd-446e-a727-49485c08cd68-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e9e1e675-406e-432a-92a3-c9fcb0dd5153 tempest-VolumesServicesTestJSON-1566828560 None] Acquiring lock "cinder-quobyte-3b5f2dea-8dbd-446e-a727-49485c08cd68" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:30 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0c16d89-8d94-467f-993b-631df5ef6857 tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa" returned: 0 in 0.557s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-a0c16d89-8d94-467f-993b-631df5ef6857 tempest-VolumesSnapshotListTestJSON-2047796889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:32:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0c16d89-8d94-467f-993b-631df5ef6857 tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.a8148cce-3f49-486a-8eb2-c05f7880f2bd 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e9e1e675-406e-432a-92a3-c9fcb0dd5153 tempest-VolumesServicesTestJSON-1566828560 None] Lock "cinder-quobyte-3b5f2dea-8dbd-446e-a727-49485c08cd68" acquired by "delete_volume" :: waited 0.033s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:30 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.a8148cce-3f49-486a-8eb2-c05f7880f2bd 1G Nov 03 07:32:30 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:30 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d23d901-ff7e-4371-a081-1ba9d29426de]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e9e1e675-406e-432a-92a3-c9fcb0dd5153 tempest-VolumesServicesTestJSON-1566828560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3b5f2dea-8dbd-446e-a727-49485c08cd68 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:31 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3b5f2dea-8dbd-446e-a727-49485c08cd68 Nov 03 07:32:31 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:31 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e9e1e675-406e-432a-92a3-c9fcb0dd5153 tempest-VolumesServicesTestJSON-1566828560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3b5f2dea-8dbd-446e-a727-49485c08cd68" returned: 0 in 0.524s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e9e1e675-406e-432a-92a3-c9fcb0dd5153 tempest-VolumesServicesTestJSON-1566828560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3b5f2dea-8dbd-446e-a727-49485c08cd68 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:31 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3b5f2dea-8dbd-446e-a727-49485c08cd68 Nov 03 07:32:31 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:31 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0c16d89-8d94-467f-993b-631df5ef6857 tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.a8148cce-3f49-486a-8eb2-c05f7880f2bd 1G" returned: 0 in 0.635s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0c16d89-8d94-467f-993b-631df5ef6857 tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.a8148cce-3f49-486a-8eb2-c05f7880f2bd {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:31 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.a8148cce-3f49-486a-8eb2-c05f7880f2bd Nov 03 07:32:31 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:31 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e9e1e675-406e-432a-92a3-c9fcb0dd5153 tempest-VolumesServicesTestJSON-1566828560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3b5f2dea-8dbd-446e-a727-49485c08cd68" returned: 0 in 0.357s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e9e1e675-406e-432a-92a3-c9fcb0dd5153 tempest-VolumesServicesTestJSON-1566828560 None] Lock "cinder-quobyte-3b5f2dea-8dbd-446e-a727-49485c08cd68" released by "delete_volume" :: held 0.943s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:31 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-e9e1e675-406e-432a-92a3-c9fcb0dd5153 tempest-VolumesServicesTestJSON-1566828560 None] Created reservations ['38ef7eb7-9df2-4d2a-ba6f-083d0809f4ed', '1bddc4af-155e-4277-a641-d28edda0a3fa', '0dc21abb-ad3d-4a00-9b9d-a85567e48d79', 'bd5b2e5c-642d-4262-b0ba-83d0f2fceae7'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:32 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0c16d89-8d94-467f-993b-631df5ef6857 tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.a8148cce-3f49-486a-8eb2-c05f7880f2bd" returned: 0 in 0.482s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:32 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-a0c16d89-8d94-467f-993b-631df5ef6857 tempest-VolumesSnapshotListTestJSON-2047796889 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.a8148cce-3f49-486a-8eb2-c05f7880f2bd is being set with open permissions: ugo+rw Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0c16d89-8d94-467f-993b-631df5ef6857 tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.a8148cce-3f49-486a-8eb2-c05f7880f2bd {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:32 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.a8148cce-3f49-486a-8eb2-c05f7880f2bd Nov 03 07:32:32 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e9e1e675-406e-432a-92a3-c9fcb0dd5153 tempest-VolumesServicesTestJSON-1566828560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e9e1e675-406e-432a-92a3-c9fcb0dd5153 tempest-VolumesServicesTestJSON-1566828560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e9e1e675-406e-432a-92a3-c9fcb0dd5153 tempest-VolumesServicesTestJSON-1566828560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e9e1e675-406e-432a-92a3-c9fcb0dd5153 tempest-VolumesServicesTestJSON-1566828560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e9e1e675-406e-432a-92a3-c9fcb0dd5153 tempest-VolumesServicesTestJSON-1566828560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e9e1e675-406e-432a-92a3-c9fcb0dd5153 tempest-VolumesServicesTestJSON-1566828560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:32 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:32:32 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Flow 'volume_create_manager' (48b08e27-807a-44d7-a95c-76b24d27830d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:32 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fc591f-fe1d-4bc2-af94-fd8b521b9334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0c16d89-8d94-467f-993b-631df5ef6857 tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.a8148cce-3f49-486a-8eb2-c05f7880f2bd" returned: 0 in 0.525s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fc591f-fe1d-4bc2-af94-fd8b521b9334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1549550316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6316b992-1802-46f4-b1b0-b9658c0bcdce,host='devstack@QuobyteHD#QuobyteHD',id=b927fb62-2afe-4e5c-9b6a-731d61fe861c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54d6c6dc3af414abdaf8d206c9beca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:32Z,use_quota=True,user_id='ddbb7a8413d74779a21eeb01affd5caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6506298a-c5b7-42d4-9637-a6c877d7adee),volume_type_id=6506298a-c5b7-42d4-9637-a6c877d7adee)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82df997e-957b-40c1-9aae-2162e33b2ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82df997e-957b-40c1-9aae-2162e33b2ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2d401a-c0b7-4723-b8dd-6f197f9b2422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2d401a-c0b7-4723-b8dd-6f197f9b2422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b927fb62-2afe-4e5c-9b6a-731d61fe861c', 'volume_name': 'volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (430f16e6-5c98-4403-a5a6-c48e112740e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (430f16e6-5c98-4403-a5a6-c48e112740e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd045b27-aa73-47b6-ab41-d339ce0ed6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:32 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Volume b927fb62-2afe-4e5c-9b6a-731d61fe861c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c', 'volume_size': 1} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:32 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a0c16d89-8d94-467f-993b-631df5ef6857 tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.431s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.031s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6316b992-1802-46f4-b1b0-b9658c0bcdce,created_at=2026-11-03T06:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1549550316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6316b992-1802-46f4-b1b0-b9658c0bcdce,host='devstack@QuobyteHD#QuobyteHD',id=b927fb62-2afe-4e5c-9b6a-731d61fe861c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54d6c6dc3af414abdaf8d206c9beca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:32Z,use_quota=True,user_id='ddbb7a8413d74779a21eeb01affd5caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6506298a-c5b7-42d4-9637-a6c877d7adee),volume_type_id=6506298a-c5b7-42d4-9637-a6c877d7adee)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Creating volume b927fb62-2afe-4e5c-9b6a-731d61fe861c {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:32:32 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e9e1e675-406e-432a-92a3-c9fcb0dd5153 tempest-VolumesServicesTestJSON-1566828560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.503s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-e9e1e675-406e-432a-92a3-c9fcb0dd5153 tempest-VolumesServicesTestJSON-1566828560 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:32 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-e9e1e675-406e-432a-92a3-c9fcb0dd5153 tempest-VolumesServicesTestJSON-1566828560 None] Deleted volume successfully. Nov 03 07:32:32 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c 1073741824 Nov 03 07:32:32 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e9e1e675-406e-432a-92a3-c9fcb0dd5153 tempest-VolumesServicesTestJSON-1566828560 None] Lock "cinder-3b5f2dea-8dbd-446e-a727-49485c08cd68-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:32 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a0c16d89-8d94-467f-993b-631df5ef6857 tempest-VolumesSnapshotListTestJSON-2047796889 None] Create snapshot completed successfully Nov 03 07:32:33 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c 1073741824" returned: 0 in 0.504s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:33 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c Nov 03 07:32:33 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:33 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c" returned: 0 in 0.338s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:32:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd045b27-aa73-47b6-ab41-d339ce0ed6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0117881-80e9-4923-afee-b56fd41d2ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:33 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Volume volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c (b927fb62-2afe-4e5c-9b6a-731d61fe861c): created successfully Nov 03 07:32:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0117881-80e9-4923-afee-b56fd41d2ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Flow 'volume_create_manager' (48b08e27-807a-44d7-a95c-76b24d27830d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:33 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a3d87608-3642-4389-8445-f451864af7f8 tempest-GroupSnapshotsV319Test-1379001571 None] Created volume successfully. Nov 03 07:32:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bc589abe-aa14-46f4-a082-3c3380011832 tempest-VolumesSnapshotListTestJSON-2047796889 None] Acquiring lock "cinder-a8148cce-3f49-486a-8eb2-c05f7880f2bd-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bc589abe-aa14-46f4-a082-3c3380011832 tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "cinder-a8148cce-3f49-486a-8eb2-c05f7880f2bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bc589abe-aa14-46f4-a082-3c3380011832 tempest-VolumesSnapshotListTestJSON-2047796889 None] Acquiring lock "cinder-quobyte-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bc589abe-aa14-46f4-a082-3c3380011832 tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "cinder-quobyte-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bc589abe-aa14-46f4-a082-3c3380011832 tempest-VolumesSnapshotListTestJSON-2047796889 None] Acquiring lock "cinder-quobyte-a8148cce-3f49-486a-8eb2-c05f7880f2bd" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bc589abe-aa14-46f4-a082-3c3380011832 tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "cinder-quobyte-a8148cce-3f49-486a-8eb2-c05f7880f2bd" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-bc589abe-aa14-46f4-a082-3c3380011832 tempest-VolumesSnapshotListTestJSON-2047796889 None] Deleting offline snapshot a8148cce-3f49-486a-8eb2-c05f7880f2bd of volume b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:32:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-bc589abe-aa14-46f4-a082-3c3380011832 tempest-VolumesSnapshotListTestJSON-2047796889 None] snapshot_file for this snap is: volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.a8148cce-3f49-486a-8eb2-c05f7880f2bd {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:32:34 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b473c4b-1d8d-4ef4-87dd-6f145af7b30c]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bc589abe-aa14-46f4-a082-3c3380011832 tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.a8148cce-3f49-486a-8eb2-c05f7880f2bd {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:35 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.a8148cce-3f49-486a-8eb2-c05f7880f2bd Nov 03 07:32:35 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:35 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bc589abe-aa14-46f4-a082-3c3380011832 tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.a8148cce-3f49-486a-8eb2-c05f7880f2bd" returned: 0 in 0.507s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-bc589abe-aa14-46f4-a082-3c3380011832 tempest-VolumesSnapshotListTestJSON-2047796889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:32:35 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca99928b-b676-41f9-b682-892c8455aaaa]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bc589abe-aa14-46f4-a082-3c3380011832 tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:35 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-06a017a8-03a2-43fe-89d7-cff0c3aa8b8f tempest-GroupSnapshotsV319Test-1379001571 None] GroupSnapshot 36d988a1-8e42-4b20-a3d9-37136b4add6c: creating. Nov 03 07:32:35 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-06a017a8-03a2-43fe-89d7-cff0c3aa8b8f tempest-GroupSnapshotsV319Test-1379001571 None] Group snapshot 36d988a1-8e42-4b20-a3d9-37136b4add6c: creating. {{(pid=87016) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 07:32:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-06a017a8-03a2-43fe-89d7-cff0c3aa8b8f tempest-GroupSnapshotsV319Test-1379001571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-06a017a8-03a2-43fe-89d7-cff0c3aa8b8f tempest-GroupSnapshotsV319Test-1379001571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-06a017a8-03a2-43fe-89d7-cff0c3aa8b8f tempest-GroupSnapshotsV319Test-1379001571 None] Creating offline snapshot fa477cb9-f50b-493d-b35a-b940370596bf of volume b927fb62-2afe-4e5c-9b6a-731d61fe861c {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:32:35 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[703f9d41-7d35-430a-adbc-29e44aa0aa52]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-06a017a8-03a2-43fe-89d7-cff0c3aa8b8f tempest-GroupSnapshotsV319Test-1379001571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:35 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa Nov 03 07:32:35 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:35 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c Nov 03 07:32:35 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:36 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bc589abe-aa14-46f4-a082-3c3380011832 tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa" returned: 0 in 0.634s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:36 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-bc589abe-aa14-46f4-a082-3c3380011832 tempest-VolumesSnapshotListTestJSON-2047796889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:32:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bc589abe-aa14-46f4-a082-3c3380011832 tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.a8148cce-3f49-486a-8eb2-c05f7880f2bd {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:36 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.a8148cce-3f49-486a-8eb2-c05f7880f2bd Nov 03 07:32:36 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:36 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-06a017a8-03a2-43fe-89d7-cff0c3aa8b8f tempest-GroupSnapshotsV319Test-1379001571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c" returned: 0 in 0.617s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-06a017a8-03a2-43fe-89d7-cff0c3aa8b8f tempest-GroupSnapshotsV319Test-1379001571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.fa477cb9-f50b-493d-b35a-b940370596bf 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:36 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.fa477cb9-f50b-493d-b35a-b940370596bf 1G Nov 03 07:32:36 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:36 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bc589abe-aa14-46f4-a082-3c3380011832 tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.a8148cce-3f49-486a-8eb2-c05f7880f2bd" returned: 0 in 0.589s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bc589abe-aa14-46f4-a082-3c3380011832 tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.a8148cce-3f49-486a-8eb2-c05f7880f2bd {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:36 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.a8148cce-3f49-486a-8eb2-c05f7880f2bd Nov 03 07:32:36 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:37 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-06a017a8-03a2-43fe-89d7-cff0c3aa8b8f tempest-GroupSnapshotsV319Test-1379001571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.fa477cb9-f50b-493d-b35a-b940370596bf 1G" returned: 0 in 0.738s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-06a017a8-03a2-43fe-89d7-cff0c3aa8b8f tempest-GroupSnapshotsV319Test-1379001571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.fa477cb9-f50b-493d-b35a-b940370596bf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:37 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.fa477cb9-f50b-493d-b35a-b940370596bf Nov 03 07:32:37 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:37 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bc589abe-aa14-46f4-a082-3c3380011832 tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.a8148cce-3f49-486a-8eb2-c05f7880f2bd" returned: 0 in 0.402s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bc589abe-aa14-46f4-a082-3c3380011832 tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "cinder-quobyte-a8148cce-3f49-486a-8eb2-c05f7880f2bd" released by "_delete_snapshot" :: held 2.374s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bc589abe-aa14-46f4-a082-3c3380011832 tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "cinder-quobyte-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7" released by "delete_snapshot" :: held 2.419s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:37 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-bc589abe-aa14-46f4-a082-3c3380011832 tempest-VolumesSnapshotListTestJSON-2047796889 None] Created reservations ['f4f97dc7-a0f8-4d6d-adae-ac77f80705b9', 'c62b8146-df3b-4637-86c1-4296197a31a1', 'cfef4dac-9594-4a68-8f07-9fe1d83cb906', 'b42eca0f-2a29-4585-b7b7-e81c2a7098c2'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:37 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-bc589abe-aa14-46f4-a082-3c3380011832 tempest-VolumesSnapshotListTestJSON-2047796889 None] Delete snapshot completed successfully. Nov 03 07:32:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bc589abe-aa14-46f4-a082-3c3380011832 tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "cinder-a8148cce-3f49-486a-8eb2-c05f7880f2bd-delete_snapshot" released by "delete_snapshot" :: held 2.702s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:37 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-06a017a8-03a2-43fe-89d7-cff0c3aa8b8f tempest-GroupSnapshotsV319Test-1379001571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.fa477cb9-f50b-493d-b35a-b940370596bf" returned: 0 in 0.478s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:37 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-06a017a8-03a2-43fe-89d7-cff0c3aa8b8f tempest-GroupSnapshotsV319Test-1379001571 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.fa477cb9-f50b-493d-b35a-b940370596bf is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:32:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-06a017a8-03a2-43fe-89d7-cff0c3aa8b8f tempest-GroupSnapshotsV319Test-1379001571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.fa477cb9-f50b-493d-b35a-b940370596bf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:37 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.fa477cb9-f50b-493d-b35a-b940370596bf Nov 03 07:32:37 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:37 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-06a017a8-03a2-43fe-89d7-cff0c3aa8b8f tempest-GroupSnapshotsV319Test-1379001571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.fa477cb9-f50b-493d-b35a-b940370596bf" returned: 0 in 0.323s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-06a017a8-03a2-43fe-89d7-cff0c3aa8b8f tempest-GroupSnapshotsV319Test-1379001571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:37 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.info Nov 03 07:32:37 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-677f2b89-9211-4913-b0a1-f911d13e501d tempest-VolumesSnapshotListTestJSON-2047796889 None] Acquiring lock "cinder-78f58875-ac6c-42f4-8e24-80f9fb8c08aa-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-677f2b89-9211-4913-b0a1-f911d13e501d tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "cinder-78f58875-ac6c-42f4-8e24-80f9fb8c08aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-677f2b89-9211-4913-b0a1-f911d13e501d tempest-VolumesSnapshotListTestJSON-2047796889 None] Acquiring lock "cinder-quobyte-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-677f2b89-9211-4913-b0a1-f911d13e501d tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "cinder-quobyte-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-677f2b89-9211-4913-b0a1-f911d13e501d tempest-VolumesSnapshotListTestJSON-2047796889 None] Acquiring lock "cinder-quobyte-78f58875-ac6c-42f4-8e24-80f9fb8c08aa" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-677f2b89-9211-4913-b0a1-f911d13e501d tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "cinder-quobyte-78f58875-ac6c-42f4-8e24-80f9fb8c08aa" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:38 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-677f2b89-9211-4913-b0a1-f911d13e501d tempest-VolumesSnapshotListTestJSON-2047796889 None] Deleting offline snapshot 78f58875-ac6c-42f4-8e24-80f9fb8c08aa of volume b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:32:38 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-677f2b89-9211-4913-b0a1-f911d13e501d tempest-VolumesSnapshotListTestJSON-2047796889 None] snapshot_file for this snap is: volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:32:38 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3363f43-e004-4f8f-9e56-b85a72f26e4b]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-677f2b89-9211-4913-b0a1-f911d13e501d tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:38 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-06a017a8-03a2-43fe-89d7-cff0c3aa8b8f tempest-GroupSnapshotsV319Test-1379001571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.info" returned: 0 in 0.419s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:38 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-06a017a8-03a2-43fe-89d7-cff0c3aa8b8f tempest-GroupSnapshotsV319Test-1379001571 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:32:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-06a017a8-03a2-43fe-89d7-cff0c3aa8b8f tempest-GroupSnapshotsV319Test-1379001571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:38 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.info Nov 03 07:32:38 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:38 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa Nov 03 07:32:38 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:38 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-06a017a8-03a2-43fe-89d7-cff0c3aa8b8f tempest-GroupSnapshotsV319Test-1379001571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.info" returned: 0 in 0.354s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-06a017a8-03a2-43fe-89d7-cff0c3aa8b8f tempest-GroupSnapshotsV319Test-1379001571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.066s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:38 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-06a017a8-03a2-43fe-89d7-cff0c3aa8b8f tempest-GroupSnapshotsV319Test-1379001571 None] group_snapshot 36d988a1-8e42-4b20-a3d9-37136b4add6c: created successfully Nov 03 07:32:38 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-677f2b89-9211-4913-b0a1-f911d13e501d tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa" returned: 0 in 0.700s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:38 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-677f2b89-9211-4913-b0a1-f911d13e501d tempest-VolumesSnapshotListTestJSON-2047796889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:32:39 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6780b6a-d49a-41e9-9e67-81619ebb48b7]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-677f2b89-9211-4913-b0a1-f911d13e501d tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:39 devstack sudo[97670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc Nov 03 07:32:39 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:39 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-677f2b89-9211-4913-b0a1-f911d13e501d tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc" returned: 0 in 0.556s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-677f2b89-9211-4913-b0a1-f911d13e501d tempest-VolumesSnapshotListTestJSON-2047796889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:32:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-677f2b89-9211-4913-b0a1-f911d13e501d tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:39 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa Nov 03 07:32:39 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:39 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-07448a56-275e-49d8-8ffb-dcce4b0e1f3b tempest-GroupSnapshotsV319Test-1379001571 None] group_snapshot 36d988a1-8e42-4b20-a3d9-37136b4add6c: deleting Nov 03 07:32:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-07448a56-275e-49d8-8ffb-dcce4b0e1f3b tempest-GroupSnapshotsV319Test-1379001571 None] group_snapshot 36d988a1-8e42-4b20-a3d9-37136b4add6c: deleting {{(pid=87016) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 07:32:39 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-07448a56-275e-49d8-8ffb-dcce4b0e1f3b tempest-GroupSnapshotsV319Test-1379001571 None] Acquiring lock "cinder-quobyte-b927fb62-2afe-4e5c-9b6a-731d61fe861c" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:39 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-07448a56-275e-49d8-8ffb-dcce4b0e1f3b tempest-GroupSnapshotsV319Test-1379001571 None] Lock "cinder-quobyte-b927fb62-2afe-4e5c-9b6a-731d61fe861c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:39 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-07448a56-275e-49d8-8ffb-dcce4b0e1f3b tempest-GroupSnapshotsV319Test-1379001571 None] Acquiring lock "cinder-quobyte-fa477cb9-f50b-493d-b35a-b940370596bf" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:39 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-07448a56-275e-49d8-8ffb-dcce4b0e1f3b tempest-GroupSnapshotsV319Test-1379001571 None] Lock "cinder-quobyte-fa477cb9-f50b-493d-b35a-b940370596bf" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-07448a56-275e-49d8-8ffb-dcce4b0e1f3b tempest-GroupSnapshotsV319Test-1379001571 None] Deleting offline snapshot fa477cb9-f50b-493d-b35a-b940370596bf of volume b927fb62-2afe-4e5c-9b6a-731d61fe861c {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:32:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-07448a56-275e-49d8-8ffb-dcce4b0e1f3b tempest-GroupSnapshotsV319Test-1379001571 None] snapshot_file for this snap is: volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.fa477cb9-f50b-493d-b35a-b940370596bf {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:32:39 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2eae6f7-cdf4-4dfa-800f-5a26611dc102]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-07448a56-275e-49d8-8ffb-dcce4b0e1f3b tempest-GroupSnapshotsV319Test-1379001571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.fa477cb9-f50b-493d-b35a-b940370596bf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:40 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.fa477cb9-f50b-493d-b35a-b940370596bf Nov 03 07:32:40 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:40 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-677f2b89-9211-4913-b0a1-f911d13e501d tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa" returned: 0 in 0.592s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-677f2b89-9211-4913-b0a1-f911d13e501d tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:40 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa Nov 03 07:32:40 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:40 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-07448a56-275e-49d8-8ffb-dcce4b0e1f3b tempest-GroupSnapshotsV319Test-1379001571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.fa477cb9-f50b-493d-b35a-b940370596bf" returned: 0 in 0.507s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-07448a56-275e-49d8-8ffb-dcce4b0e1f3b tempest-GroupSnapshotsV319Test-1379001571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:32:40 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-677f2b89-9211-4913-b0a1-f911d13e501d tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.78f58875-ac6c-42f4-8e24-80f9fb8c08aa" returned: 0 in 0.347s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:40 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d58f8a1-aa98-4726-837d-753a93ebc4a9]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-07448a56-275e-49d8-8ffb-dcce4b0e1f3b tempest-GroupSnapshotsV319Test-1379001571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:40 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-677f2b89-9211-4913-b0a1-f911d13e501d tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "cinder-quobyte-78f58875-ac6c-42f4-8e24-80f9fb8c08aa" released by "_delete_snapshot" :: held 2.375s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:40 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-677f2b89-9211-4913-b0a1-f911d13e501d tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "cinder-quobyte-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7" released by "delete_snapshot" :: held 2.419s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:40 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-677f2b89-9211-4913-b0a1-f911d13e501d tempest-VolumesSnapshotListTestJSON-2047796889 None] Created reservations ['3aa732dd-9d3f-4bc5-8709-2aa6e36f9c78', '8789e994-fb1c-41e8-9735-2333e2665b19', '0c38d77b-8ad1-486a-9642-2c43b3b19530', '65b1015d-8067-49e2-879b-de4400c6ee63'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:40 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c Nov 03 07:32:40 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:40 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-677f2b89-9211-4913-b0a1-f911d13e501d tempest-VolumesSnapshotListTestJSON-2047796889 None] Delete snapshot completed successfully. Nov 03 07:32:40 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-677f2b89-9211-4913-b0a1-f911d13e501d tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "cinder-78f58875-ac6c-42f4-8e24-80f9fb8c08aa-delete_snapshot" released by "delete_snapshot" :: held 2.618s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:41 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-07448a56-275e-49d8-8ffb-dcce4b0e1f3b tempest-GroupSnapshotsV319Test-1379001571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c" returned: 0 in 0.482s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-07448a56-275e-49d8-8ffb-dcce4b0e1f3b tempest-GroupSnapshotsV319Test-1379001571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.fa477cb9-f50b-493d-b35a-b940370596bf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:41 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.fa477cb9-f50b-493d-b35a-b940370596bf Nov 03 07:32:41 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:41 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-00d928a6-77b6-4476-b8f8-3bebe433d0c1 tempest-VolumesSnapshotListTestJSON-2047796889 None] Acquiring lock "cinder-f9c96eb5-4e9b-44c0-ad01-d87abf4203bc-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:41 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-00d928a6-77b6-4476-b8f8-3bebe433d0c1 tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "cinder-f9c96eb5-4e9b-44c0-ad01-d87abf4203bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:41 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-00d928a6-77b6-4476-b8f8-3bebe433d0c1 tempest-VolumesSnapshotListTestJSON-2047796889 None] Acquiring lock "cinder-quobyte-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:41 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-00d928a6-77b6-4476-b8f8-3bebe433d0c1 tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "cinder-quobyte-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:41 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-00d928a6-77b6-4476-b8f8-3bebe433d0c1 tempest-VolumesSnapshotListTestJSON-2047796889 None] Acquiring lock "cinder-quobyte-f9c96eb5-4e9b-44c0-ad01-d87abf4203bc" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:41 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-00d928a6-77b6-4476-b8f8-3bebe433d0c1 tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "cinder-quobyte-f9c96eb5-4e9b-44c0-ad01-d87abf4203bc" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:41 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-00d928a6-77b6-4476-b8f8-3bebe433d0c1 tempest-VolumesSnapshotListTestJSON-2047796889 None] Deleting offline snapshot f9c96eb5-4e9b-44c0-ad01-d87abf4203bc of volume b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:32:41 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:41 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-00d928a6-77b6-4476-b8f8-3bebe433d0c1 tempest-VolumesSnapshotListTestJSON-2047796889 None] snapshot_file for this snap is: volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:32:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-07448a56-275e-49d8-8ffb-dcce4b0e1f3b tempest-GroupSnapshotsV319Test-1379001571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.fa477cb9-f50b-493d-b35a-b940370596bf" returned: 0 in 0.459s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-07448a56-275e-49d8-8ffb-dcce4b0e1f3b tempest-GroupSnapshotsV319Test-1379001571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.fa477cb9-f50b-493d-b35a-b940370596bf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:41 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dd1816-d52e-4e14-9bb3-2532221467bb]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-00d928a6-77b6-4476-b8f8-3bebe433d0c1 tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:41 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.fa477cb9-f50b-493d-b35a-b940370596bf Nov 03 07:32:41 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:41 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc Nov 03 07:32:41 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:41 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-07448a56-275e-49d8-8ffb-dcce4b0e1f3b tempest-GroupSnapshotsV319Test-1379001571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c.fa477cb9-f50b-493d-b35a-b940370596bf" returned: 0 in 0.394s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:41 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-07448a56-275e-49d8-8ffb-dcce4b0e1f3b tempest-GroupSnapshotsV319Test-1379001571 None] Lock "cinder-quobyte-fa477cb9-f50b-493d-b35a-b940370596bf" released by "_delete_snapshot" :: held 1.989s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:41 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-07448a56-275e-49d8-8ffb-dcce4b0e1f3b tempest-GroupSnapshotsV319Test-1379001571 None] Lock "cinder-quobyte-b927fb62-2afe-4e5c-9b6a-731d61fe861c" released by "delete_snapshot" :: held 2.024s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:41 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-00d928a6-77b6-4476-b8f8-3bebe433d0c1 tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc" returned: 0 in 0.477s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:41 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-00d928a6-77b6-4476-b8f8-3bebe433d0c1 tempest-VolumesSnapshotListTestJSON-2047796889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[10658900-6d85-4e89-91e3-38fe38384c29]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-00d928a6-77b6-4476-b8f8-3bebe433d0c1 tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:42 devstack cinder-volume[87016]: WARNING cinder.quota [None req-07448a56-275e-49d8-8ffb-dcce4b0e1f3b tempest-GroupSnapshotsV319Test-1379001571 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2008417106 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2008417106, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:32:42 devstack cinder-volume[87016]: WARNING cinder.quota [None req-07448a56-275e-49d8-8ffb-dcce4b0e1f3b tempest-GroupSnapshotsV319Test-1379001571 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2008417106 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2008417106, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Flow 'volume_create_manager' (1e43510b-af49-47f5-9d21-12b19f5c8450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd72157f-28c2-4d05-b8e1-4e86ae9f258b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd72157f-28c2-4d05-b8e1-4e86ae9f258b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-847713538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=207d2fb6-1e1f-40a6-9c9d-0c29ece5a202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc96600c2c5e4169a3a486d401bc8abe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:42Z,use_quota=True,user_id='2497141708e9437cbda644a3fd617fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f243987-4c81-45b7-8b42-fc8d9213d26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f243987-4c81-45b7-8b42-fc8d9213d26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf962ab-d55e-41ea-a493-935e218a9c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf962ab-d55e-41ea-a493-935e218a9c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '207d2fb6-1e1f-40a6-9c9d-0c29ece5a202', 'volume_name': 'volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441ddc34-4a69-46a7-8a21-8594ad39c940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441ddc34-4a69-46a7-8a21-8594ad39c940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22fffa3b-cc55-429e-ac72-ec176f5f5cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:42 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Volume 207d2fb6-1e1f-40a6-9c9d-0c29ece5a202: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202', 'volume_size': 1} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:42 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-847713538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=207d2fb6-1e1f-40a6-9c9d-0c29ece5a202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc96600c2c5e4169a3a486d401bc8abe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:42Z,use_quota=True,user_id='2497141708e9437cbda644a3fd617fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:32:42 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Creating volume 207d2fb6-1e1f-40a6-9c9d-0c29ece5a202 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:32:42 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-07448a56-275e-49d8-8ffb-dcce4b0e1f3b tempest-GroupSnapshotsV319Test-1379001571 None] Created reservations ['90fdc37c-abcf-4f5d-b5d5-4ce658b8ddf5', '49550b6e-4926-4cb4-92b0-6bf605f74cc4', '858171af-efe4-42ec-beb5-112c09b9b5f5', 'fe2258bf-7162-46b4-947c-8f7a6766d3f3'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:42 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202 1073741824 Nov 03 07:32:42 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:42 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-07448a56-275e-49d8-8ffb-dcce4b0e1f3b tempest-GroupSnapshotsV319Test-1379001571 None] group_snapshot 36d988a1-8e42-4b20-a3d9-37136b4add6c: deleted successfully Nov 03 07:32:42 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-00d928a6-77b6-4476-b8f8-3bebe433d0c1 tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7" returned: 0 in 0.514s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-00d928a6-77b6-4476-b8f8-3bebe433d0c1 tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:42 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc Nov 03 07:32:42 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:42 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202 1073741824" returned: 0 in 0.554s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:42 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202 Nov 03 07:32:42 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:42 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-00d928a6-77b6-4476-b8f8-3bebe433d0c1 tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc" returned: 0 in 0.413s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-00d928a6-77b6-4476-b8f8-3bebe433d0c1 tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:42 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc Nov 03 07:32:42 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:43 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202" returned: 0 in 0.297s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:43 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:32:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22fffa3b-cc55-429e-ac72-ec176f5f5cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b0dcec-8a84-4143-bdd9-1f9ba7f74103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:43 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Volume volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202 (207d2fb6-1e1f-40a6-9c9d-0c29ece5a202): created successfully Nov 03 07:32:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b0dcec-8a84-4143-bdd9-1f9ba7f74103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Flow 'volume_create_manager' (1e43510b-af49-47f5-9d21-12b19f5c8450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:43 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-9512d1d5-9736-4b85-bf0c-92809e79279f tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Created volume successfully. Nov 03 07:32:43 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-00d928a6-77b6-4476-b8f8-3bebe433d0c1 tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7.f9c96eb5-4e9b-44c0-ad01-d87abf4203bc" returned: 0 in 0.280s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-00d928a6-77b6-4476-b8f8-3bebe433d0c1 tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "cinder-quobyte-f9c96eb5-4e9b-44c0-ad01-d87abf4203bc" released by "_delete_snapshot" :: held 1.836s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-00d928a6-77b6-4476-b8f8-3bebe433d0c1 tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "cinder-quobyte-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7" released by "delete_snapshot" :: held 1.868s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:43 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-00d928a6-77b6-4476-b8f8-3bebe433d0c1 tempest-VolumesSnapshotListTestJSON-2047796889 None] Created reservations ['2dc3ed79-48d2-42d7-a5bc-3f8bcbcb6e1b', '96650d8c-2d3a-4d6a-af35-e5e00c3e6619', '0f77405d-36d0-4e49-aee4-e1b5e015af17', '75e1e5c5-9033-42c8-bb19-f6127ef1476e'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:43 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-00d928a6-77b6-4476-b8f8-3bebe433d0c1 tempest-VolumesSnapshotListTestJSON-2047796889 None] Delete snapshot completed successfully. Nov 03 07:32:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-00d928a6-77b6-4476-b8f8-3bebe433d0c1 tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "cinder-f9c96eb5-4e9b-44c0-ad01-d87abf4203bc-delete_snapshot" released by "delete_snapshot" :: held 2.032s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-85e3b620-0937-4d19-87ac-39815a3521fc tempest-GroupSnapshotsV319Test-1379001571 None] Acquiring lock "cinder-quobyte-b927fb62-2afe-4e5c-9b6a-731d61fe861c" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-85e3b620-0937-4d19-87ac-39815a3521fc tempest-GroupSnapshotsV319Test-1379001571 None] Lock "cinder-quobyte-b927fb62-2afe-4e5c-9b6a-731d61fe861c" acquired by "delete_volume" :: waited 0.020s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:43 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1cf562-21dc-4307-a71f-1dac360605f6]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-85e3b620-0937-4d19-87ac-39815a3521fc tempest-GroupSnapshotsV319Test-1379001571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-479f789b-bc0d-4564-b009-51ebfd0a1bbd tempest-VolumesSnapshotListTestJSON-2047796889 None] Acquiring lock "cinder-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-479f789b-bc0d-4564-b009-51ebfd0a1bbd tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "cinder-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-479f789b-bc0d-4564-b009-51ebfd0a1bbd tempest-VolumesSnapshotListTestJSON-2047796889 None] Acquiring lock "cinder-quobyte-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-479f789b-bc0d-4564-b009-51ebfd0a1bbd tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "cinder-quobyte-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7" acquired by "delete_volume" :: waited 0.020s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:43 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c Nov 03 07:32:43 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:43 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[0caa588d-d993-4536-bd06-f3f3f8a32cdf]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-479f789b-bc0d-4564-b009-51ebfd0a1bbd tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:43 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 Nov 03 07:32:43 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:44 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-85e3b620-0937-4d19-87ac-39815a3521fc tempest-GroupSnapshotsV319Test-1379001571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c" returned: 0 in 0.485s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-85e3b620-0937-4d19-87ac-39815a3521fc tempest-GroupSnapshotsV319Test-1379001571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:44 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c Nov 03 07:32:44 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:44 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-479f789b-bc0d-4564-b009-51ebfd0a1bbd tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7" returned: 0 in 0.444s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-479f789b-bc0d-4564-b009-51ebfd0a1bbd tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:44 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7 Nov 03 07:32:44 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e5c9c5c7-df0e-4804-bab2-818457822f0e tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e5c9c5c7-df0e-4804-bab2-818457822f0e tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-e5c9c5c7-df0e-4804-bab2-818457822f0e tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Creating offline snapshot a10ec9a1-4305-472d-9ddf-8f70ae91a7e3 of volume 207d2fb6-1e1f-40a6-9c9d-0c29ece5a202 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[911130ef-53b6-48f5-9289-7fe0259fa6ee]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e5c9c5c7-df0e-4804-bab2-818457822f0e tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:44 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-85e3b620-0937-4d19-87ac-39815a3521fc tempest-GroupSnapshotsV319Test-1379001571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b927fb62-2afe-4e5c-9b6a-731d61fe861c" returned: 0 in 0.414s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:44 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-479f789b-bc0d-4564-b009-51ebfd0a1bbd tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7" returned: 0 in 0.313s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-85e3b620-0937-4d19-87ac-39815a3521fc tempest-GroupSnapshotsV319Test-1379001571 None] Lock "cinder-quobyte-b927fb62-2afe-4e5c-9b6a-731d61fe861c" released by "delete_volume" :: held 0.990s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-479f789b-bc0d-4564-b009-51ebfd0a1bbd tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "cinder-quobyte-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7" released by "delete_volume" :: held 0.842s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:44 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202 Nov 03 07:32:44 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-479f789b-bc0d-4564-b009-51ebfd0a1bbd tempest-VolumesSnapshotListTestJSON-2047796889 None] Created reservations ['05181c2b-c018-46c9-899a-0b96c3aa1153', 'f01c265a-26e7-44a2-b8f6-aa6b26610270', 'cb29577b-522f-4f43-aceb-e8901de3e6bd', '02ab30e1-3a06-4ab0-8f5f-77887567953c'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-85e3b620-0937-4d19-87ac-39815a3521fc tempest-GroupSnapshotsV319Test-1379001571 None] Created reservations ['e67da642-9735-4f83-b2d9-596f1ec96ba4'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:44 devstack cinder-volume[87016]: WARNING cinder.quota [None req-85e3b620-0937-4d19-87ac-39815a3521fc tempest-GroupSnapshotsV319Test-1379001571 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2008417106 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2008417106, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-479f789b-bc0d-4564-b009-51ebfd0a1bbd tempest-VolumesSnapshotListTestJSON-2047796889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-479f789b-bc0d-4564-b009-51ebfd0a1bbd tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-479f789b-bc0d-4564-b009-51ebfd0a1bbd tempest-VolumesSnapshotListTestJSON-2047796889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-479f789b-bc0d-4564-b009-51ebfd0a1bbd tempest-VolumesSnapshotListTestJSON-2047796889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-479f789b-bc0d-4564-b009-51ebfd0a1bbd tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-479f789b-bc0d-4564-b009-51ebfd0a1bbd tempest-VolumesSnapshotListTestJSON-2047796889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-85e3b620-0937-4d19-87ac-39815a3521fc tempest-GroupSnapshotsV319Test-1379001571 None] Created reservations ['8a42fe21-fd99-4e3a-8669-dca704024d8b', 'bf12252b-eefd-4fee-8188-89e4b4e8ccb0', '4d5e232b-7556-44ff-9c01-c8eaeee18b5a', '74f56a7c-5998-400b-abd8-38522cd8313d'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:44 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:32:44 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:44 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e5c9c5c7-df0e-4804-bab2-818457822f0e tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202" returned: 0 in 0.520s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e5c9c5c7-df0e-4804-bab2-818457822f0e tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.a10ec9a1-4305-472d-9ddf-8f70ae91a7e3 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:45 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.a10ec9a1-4305-472d-9ddf-8f70ae91a7e3 1G Nov 03 07:32:45 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-85e3b620-0937-4d19-87ac-39815a3521fc tempest-GroupSnapshotsV319Test-1379001571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-85e3b620-0937-4d19-87ac-39815a3521fc tempest-GroupSnapshotsV319Test-1379001571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:45 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-85e3b620-0937-4d19-87ac-39815a3521fc tempest-GroupSnapshotsV319Test-1379001571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:45 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-85e3b620-0937-4d19-87ac-39815a3521fc tempest-GroupSnapshotsV319Test-1379001571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-85e3b620-0937-4d19-87ac-39815a3521fc tempest-GroupSnapshotsV319Test-1379001571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-85e3b620-0937-4d19-87ac-39815a3521fc tempest-GroupSnapshotsV319Test-1379001571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:45 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:32:45 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:45 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-479f789b-bc0d-4564-b009-51ebfd0a1bbd tempest-VolumesSnapshotListTestJSON-2047796889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.471s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:45 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-479f789b-bc0d-4564-b009-51ebfd0a1bbd tempest-VolumesSnapshotListTestJSON-2047796889 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:45 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-479f789b-bc0d-4564-b009-51ebfd0a1bbd tempest-VolumesSnapshotListTestJSON-2047796889 None] Deleted volume successfully. Nov 03 07:32:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-479f789b-bc0d-4564-b009-51ebfd0a1bbd tempest-VolumesSnapshotListTestJSON-2047796889 None] Lock "cinder-b9e4a68d-8a83-4a08-a76c-3143db4cf7b7-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:45 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-85e3b620-0937-4d19-87ac-39815a3521fc tempest-GroupSnapshotsV319Test-1379001571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.398s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:45 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-85e3b620-0937-4d19-87ac-39815a3521fc tempest-GroupSnapshotsV319Test-1379001571 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:45 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-85e3b620-0937-4d19-87ac-39815a3521fc tempest-GroupSnapshotsV319Test-1379001571 None] Delete group completed successfully. Nov 03 07:32:45 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e5c9c5c7-df0e-4804-bab2-818457822f0e tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.a10ec9a1-4305-472d-9ddf-8f70ae91a7e3 1G" returned: 0 in 0.555s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e5c9c5c7-df0e-4804-bab2-818457822f0e tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.a10ec9a1-4305-472d-9ddf-8f70ae91a7e3 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:45 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.a10ec9a1-4305-472d-9ddf-8f70ae91a7e3 Nov 03 07:32:45 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:45 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e5c9c5c7-df0e-4804-bab2-818457822f0e tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.a10ec9a1-4305-472d-9ddf-8f70ae91a7e3" returned: 0 in 0.358s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:45 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-e5c9c5c7-df0e-4804-bab2-818457822f0e tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.a10ec9a1-4305-472d-9ddf-8f70ae91a7e3 is being set with open permissions: ugo+rw Nov 03 07:32:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e5c9c5c7-df0e-4804-bab2-818457822f0e tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.a10ec9a1-4305-472d-9ddf-8f70ae91a7e3 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:45 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.a10ec9a1-4305-472d-9ddf-8f70ae91a7e3 Nov 03 07:32:45 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:46 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e5c9c5c7-df0e-4804-bab2-818457822f0e tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.a10ec9a1-4305-472d-9ddf-8f70ae91a7e3" returned: 0 in 0.543s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:46 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=117,cinder:UPDATE=159,cinder:DELETE=13,cinder:INSERT=38 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:32:46 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=131,cinder:UPDATE=152,cinder:INSERT=39,cinder:DELETE=10 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:32:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e5c9c5c7-df0e-4804-bab2-818457822f0e tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:46 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.info Nov 03 07:32:46 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:46 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e5c9c5c7-df0e-4804-bab2-818457822f0e tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.info" returned: 0 in 0.360s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:46 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-e5c9c5c7-df0e-4804-bab2-818457822f0e tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.info is being set with open permissions: ugo+rw Nov 03 07:32:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e5c9c5c7-df0e-4804-bab2-818457822f0e tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:46 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.info Nov 03 07:32:46 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:47 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e5c9c5c7-df0e-4804-bab2-818457822f0e tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.info" returned: 0 in 0.345s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e5c9c5c7-df0e-4804-bab2-818457822f0e tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.866s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:47 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-e5c9c5c7-df0e-4804-bab2-818457822f0e tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Create snapshot completed successfully Nov 03 07:32:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-18a12a83-2809-4e02-9ce0-8bb4046d14b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Acquiring lock "cinder-a10ec9a1-4305-472d-9ddf-8f70ae91a7e3-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-18a12a83-2809-4e02-9ce0-8bb4046d14b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Lock "cinder-a10ec9a1-4305-472d-9ddf-8f70ae91a7e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-18a12a83-2809-4e02-9ce0-8bb4046d14b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Acquiring lock "cinder-quobyte-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-18a12a83-2809-4e02-9ce0-8bb4046d14b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Lock "cinder-quobyte-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-18a12a83-2809-4e02-9ce0-8bb4046d14b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Acquiring lock "cinder-quobyte-a10ec9a1-4305-472d-9ddf-8f70ae91a7e3" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-18a12a83-2809-4e02-9ce0-8bb4046d14b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Lock "cinder-quobyte-a10ec9a1-4305-472d-9ddf-8f70ae91a7e3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-18a12a83-2809-4e02-9ce0-8bb4046d14b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Deleting offline snapshot a10ec9a1-4305-472d-9ddf-8f70ae91a7e3 of volume 207d2fb6-1e1f-40a6-9c9d-0c29ece5a202 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:32:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-18a12a83-2809-4e02-9ce0-8bb4046d14b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] snapshot_file for this snap is: volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.a10ec9a1-4305-472d-9ddf-8f70ae91a7e3 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:32:48 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50fdb70-9e6f-4a2e-834c-262e2599ba08]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-18a12a83-2809-4e02-9ce0-8bb4046d14b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.a10ec9a1-4305-472d-9ddf-8f70ae91a7e3 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:48 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.a10ec9a1-4305-472d-9ddf-8f70ae91a7e3 Nov 03 07:32:48 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:48 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-18a12a83-2809-4e02-9ce0-8bb4046d14b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.a10ec9a1-4305-472d-9ddf-8f70ae91a7e3" returned: 0 in 0.458s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-18a12a83-2809-4e02-9ce0-8bb4046d14b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:32:48 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b425f4b-9297-45ac-9f11-1f79f6bf364b]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-18a12a83-2809-4e02-9ce0-8bb4046d14b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:49 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202 Nov 03 07:32:49 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:32:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:49 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:32:49 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:49 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:49 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.471s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-18a12a83-2809-4e02-9ce0-8bb4046d14b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202" returned: 0 in 0.761s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-18a12a83-2809-4e02-9ce0-8bb4046d14b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.a10ec9a1-4305-472d-9ddf-8f70ae91a7e3 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:32:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 28 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:32:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:32:49 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.a10ec9a1-4305-472d-9ddf-8f70ae91a7e3 Nov 03 07:32:49 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:50 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-18a12a83-2809-4e02-9ce0-8bb4046d14b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.a10ec9a1-4305-472d-9ddf-8f70ae91a7e3" returned: 0 in 0.569s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-18a12a83-2809-4e02-9ce0-8bb4046d14b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.a10ec9a1-4305-472d-9ddf-8f70ae91a7e3 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:50 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.a10ec9a1-4305-472d-9ddf-8f70ae91a7e3 Nov 03 07:32:50 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:50 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-18a12a83-2809-4e02-9ce0-8bb4046d14b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202.a10ec9a1-4305-472d-9ddf-8f70ae91a7e3" returned: 0 in 0.509s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-18a12a83-2809-4e02-9ce0-8bb4046d14b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Lock "cinder-quobyte-a10ec9a1-4305-472d-9ddf-8f70ae91a7e3" released by "_delete_snapshot" :: held 2.488s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-18a12a83-2809-4e02-9ce0-8bb4046d14b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Lock "cinder-quobyte-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202" released by "delete_snapshot" :: held 2.524s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:50 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-18a12a83-2809-4e02-9ce0-8bb4046d14b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Created reservations ['992627fb-bb2d-48e0-8d99-f0000182f355', '1cd9e92c-31e4-416d-b140-7539db882f10', '569d0f92-27e0-4787-8b2c-1438857b33a7', 'fd69dbb4-3026-4870-83a3-c28d4df77fd8'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:51 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-18a12a83-2809-4e02-9ce0-8bb4046d14b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Delete snapshot completed successfully. Nov 03 07:32:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-18a12a83-2809-4e02-9ce0-8bb4046d14b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Lock "cinder-a10ec9a1-4305-472d-9ddf-8f70ae91a7e3-delete_snapshot" released by "delete_snapshot" :: held 2.829s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-558c2aae-fad3-49f6-9735-1d4133712c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Acquiring lock "cinder-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-558c2aae-fad3-49f6-9735-1d4133712c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Lock "cinder-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-558c2aae-fad3-49f6-9735-1d4133712c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Acquiring lock "cinder-quobyte-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-558c2aae-fad3-49f6-9735-1d4133712c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Lock "cinder-quobyte-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202" acquired by "delete_volume" :: waited 0.027s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:51 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf84a18-f8af-427f-afe8-d2314adc6be3]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-558c2aae-fad3-49f6-9735-1d4133712c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:52 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202 Nov 03 07:32:52 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:52 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-558c2aae-fad3-49f6-9735-1d4133712c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202" returned: 0 in 0.604s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-558c2aae-fad3-49f6-9735-1d4133712c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:52 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202 Nov 03 07:32:52 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:53 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-558c2aae-fad3-49f6-9735-1d4133712c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202" returned: 0 in 0.551s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-558c2aae-fad3-49f6-9735-1d4133712c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Lock "cinder-quobyte-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202" released by "delete_volume" :: held 1.268s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:53 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-558c2aae-fad3-49f6-9735-1d4133712c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Created reservations ['4314a7f3-fb61-46a2-a2d5-6dae4cdaf76b', '1460dc24-2353-4d9d-8689-9f1469eb97d2', '8072ad85-ef62-417a-9369-693635f404e1', '4deb30d4-6f2c-46fc-8edf-e4fe219ee9ff'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-558c2aae-fad3-49f6-9735-1d4133712c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-558c2aae-fad3-49f6-9735-1d4133712c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-558c2aae-fad3-49f6-9735-1d4133712c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-558c2aae-fad3-49f6-9735-1d4133712c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-558c2aae-fad3-49f6-9735-1d4133712c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-558c2aae-fad3-49f6-9735-1d4133712c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:53 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:32:53 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:53 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-558c2aae-fad3-49f6-9735-1d4133712c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.490s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:53 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-558c2aae-fad3-49f6-9735-1d4133712c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:53 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-558c2aae-fad3-49f6-9735-1d4133712c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Deleted volume successfully. Nov 03 07:32:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-558c2aae-fad3-49f6-9735-1d4133712c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-587592125 None] Lock "cinder-207d2fb6-1e1f-40a6-9c9d-0c29ece5a202-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1ee89c31-3358-4c93-920c-51dfd635bf98 tempest-AttachVolumeShelveTestJSON-21019857 None] Acquiring lock "cinder-79fcdb8f-b220-46c0-99dd-770f7adb2614-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1ee89c31-3358-4c93-920c-51dfd635bf98 tempest-AttachVolumeShelveTestJSON-21019857 None] Lock "cinder-79fcdb8f-b220-46c0-99dd-770f7adb2614-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1ee89c31-3358-4c93-920c-51dfd635bf98 tempest-AttachVolumeShelveTestJSON-21019857 None] Acquiring lock "cinder-quobyte-79fcdb8f-b220-46c0-99dd-770f7adb2614" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:58 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1ee89c31-3358-4c93-920c-51dfd635bf98 tempest-AttachVolumeShelveTestJSON-21019857 None] Lock "cinder-quobyte-79fcdb8f-b220-46c0-99dd-770f7adb2614" acquired by "delete_volume" :: waited 0.025s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:58 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c62bf5-cfa3-46f8-841f-c2b5456fa4c0]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1ee89c31-3358-4c93-920c-51dfd635bf98 tempest-AttachVolumeShelveTestJSON-21019857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79fcdb8f-b220-46c0-99dd-770f7adb2614 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:58 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79fcdb8f-b220-46c0-99dd-770f7adb2614 Nov 03 07:32:58 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:58 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1ee89c31-3358-4c93-920c-51dfd635bf98 tempest-AttachVolumeShelveTestJSON-21019857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79fcdb8f-b220-46c0-99dd-770f7adb2614" returned: 0 in 0.620s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1ee89c31-3358-4c93-920c-51dfd635bf98 tempest-AttachVolumeShelveTestJSON-21019857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79fcdb8f-b220-46c0-99dd-770f7adb2614 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:58 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79fcdb8f-b220-46c0-99dd-770f7adb2614 Nov 03 07:32:58 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:59 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1ee89c31-3358-4c93-920c-51dfd635bf98 tempest-AttachVolumeShelveTestJSON-21019857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-79fcdb8f-b220-46c0-99dd-770f7adb2614" returned: 0 in 0.358s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1ee89c31-3358-4c93-920c-51dfd635bf98 tempest-AttachVolumeShelveTestJSON-21019857 None] Lock "cinder-quobyte-79fcdb8f-b220-46c0-99dd-770f7adb2614" released by "delete_volume" :: held 1.052s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:59 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-1ee89c31-3358-4c93-920c-51dfd635bf98 tempest-AttachVolumeShelveTestJSON-21019857 None] Created reservations ['811b3d0c-b6c7-4efa-b2c2-74f126d0275b', '50d278fe-e388-4098-84cf-863188df18f7', '49a0dd8d-c247-4ba4-828d-a28dd91db6d4', '29d90bc4-f081-41c7-bfb8-69d2dba486fe'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1ee89c31-3358-4c93-920c-51dfd635bf98 tempest-AttachVolumeShelveTestJSON-21019857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1ee89c31-3358-4c93-920c-51dfd635bf98 tempest-AttachVolumeShelveTestJSON-21019857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:59 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1ee89c31-3358-4c93-920c-51dfd635bf98 tempest-AttachVolumeShelveTestJSON-21019857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:59 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1ee89c31-3358-4c93-920c-51dfd635bf98 tempest-AttachVolumeShelveTestJSON-21019857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1ee89c31-3358-4c93-920c-51dfd635bf98 tempest-AttachVolumeShelveTestJSON-21019857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1ee89c31-3358-4c93-920c-51dfd635bf98 tempest-AttachVolumeShelveTestJSON-21019857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:59 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:32:59 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:59 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1ee89c31-3358-4c93-920c-51dfd635bf98 tempest-AttachVolumeShelveTestJSON-21019857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.377s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:59 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-1ee89c31-3358-4c93-920c-51dfd635bf98 tempest-AttachVolumeShelveTestJSON-21019857 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:59 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-1ee89c31-3358-4c93-920c-51dfd635bf98 tempest-AttachVolumeShelveTestJSON-21019857 None] Deleted volume successfully. Nov 03 07:32:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1ee89c31-3358-4c93-920c-51dfd635bf98 tempest-AttachVolumeShelveTestJSON-21019857 None] Lock "cinder-79fcdb8f-b220-46c0-99dd-770f7adb2614-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:07 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:33:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Flow 'volume_create_manager' (84f22ad6-e2c2-416d-a93d-88586a5aa82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa44327-e07d-4249-9026-0f6aa68681a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa44327-e07d-4249-9026-0f6aa68681a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-230648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b6c5736-97e7-4ca2-a722-26c13181e79e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a7571562624bd5baea2962805289ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:08Z,use_quota=True,user_id='f1bce040bbaa4cb982926b22f9659532',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bc0332-8d34-4e34-973a-541155d75453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bc0332-8d34-4e34-973a-541155d75453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43cf59c-6c6b-4fa6-bcf9-0bb773bf5e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:07 devstack cinder-volume[87016]: DEBUG cinder.image.glance [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Creating Keystone auth plugin from conf {{(pid=87016) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:33:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43cf59c-6c6b-4fa6-bcf9-0bb773bf5e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2b6c5736-97e7-4ca2-a722-26c13181e79e', 'volume_name': 'volume-2b6c5736-97e7-4ca2-a722-26c13181e79e', 'volume_size': 1, 'image_id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bde64ec799a64fc39c0407ed31a11129', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'created_at': datetime.datetime(2026, 11, 3, 6, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff95c92f-8869-4b37-acc8-7489cb864faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff95c92f-8869-4b37-acc8-7489cb864faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e7726b-e9e4-4f36-ba99-0800c2955163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:08 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Volume 2b6c5736-97e7-4ca2-a722-26c13181e79e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2b6c5736-97e7-4ca2-a722-26c13181e79e', 'volume_size': 1, 'image_id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bde64ec799a64fc39c0407ed31a11129', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'created_at': datetime.datetime(2026, 11, 3, 6, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 07:33:08 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Trying to clone 2b6c5736-97e7-4ca2-a722-26c13181e79e from image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb at location (None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}]). {{(pid=87016) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:33:09 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7dwn2dg1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:33:09 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Image download 20.69 MB at 20.69 MB/s Nov 03 07:33:09 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[61099bf2-101c-4115-ad50-4941de97d6e1]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7dwn2dg1devstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:09 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7dwn2dg1devstack@QuobyteHD Nov 03 07:33:09 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:09 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7dwn2dg1devstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:09 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Temporary image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb is fetched for user f1bce040bbaa4cb982926b22f9659532. {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:33:09 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadab1c0-48eb-42dd-8399-622a9e95a0ca]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7dwn2dg1devstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:09 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7dwn2dg1devstack@QuobyteHD Nov 03 07:33:09 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:10 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7dwn2dg1devstack@QuobyteHD" returned: 0 in 0.563s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-230648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b6c5736-97e7-4ca2-a722-26c13181e79e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a7571562624bd5baea2962805289ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:08Z,use_quota=True,user_id='f1bce040bbaa4cb982926b22f9659532',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:33:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Creating volume 2b6c5736-97e7-4ca2-a722-26c13181e79e {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:33:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:33:10 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:33:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2b6c5736-97e7-4ca2-a722-26c13181e79e 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:10 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2b6c5736-97e7-4ca2-a722-26c13181e79e 1073741824 Nov 03 07:33:10 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:10 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2b6c5736-97e7-4ca2-a722-26c13181e79e 1073741824" returned: 0 in 0.636s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2b6c5736-97e7-4ca2-a722-26c13181e79e {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:11 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2b6c5736-97e7-4ca2-a722-26c13181e79e Nov 03 07:33:11 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:11 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2b6c5736-97e7-4ca2-a722-26c13181e79e" returned: 0 in 0.294s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:11 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:33:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:11 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Attempting download of 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb ((None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}])) to volume 2b6c5736-97e7-4ca2-a722-26c13181e79e. {{(pid=87016) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 03 07:33:11 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[00617a36-f13f-4d9b-a2eb-d92117bd82ff]: (4, 'raw') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_h0ob1111 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:11 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_h0ob1111 Nov 03 07:33:11 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:11 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_h0ob1111" returned: 0 in 0.440s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_h0ob1111 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:11 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_h0ob1111 Nov 03 07:33:11 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:12 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_h0ob1111" returned: 1 in 0.441s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_h0ob1111' failed. Not Retrying. {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:33:12 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90e6dc5-bf66-4557-a381-21f4fc0c1350]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7dwn2dg1devstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:12 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7dwn2dg1devstack@QuobyteHD Nov 03 07:33:12 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:12 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7dwn2dg1devstack@QuobyteHD" returned: 0 in 0.560s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:12 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb was qcow2, converting to qcow2 {{(pid=87016) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:33:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7dwn2dg1devstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2b6c5736-97e7-4ca2-a722-26c13181e79e {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:12 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7dwn2dg1devstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2b6c5736-97e7-4ca2-a722-26c13181e79e Nov 03 07:33:12 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:15 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7dwn2dg1devstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2b6c5736-97e7-4ca2-a722-26c13181e79e" returned: 0 in 2.910s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:15 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7dwn2dg1devstack@QuobyteHD, size 112.00 MB, duration 2.91 sec, destination /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2b6c5736-97e7-4ca2-a722-26c13181e79e {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:33:15 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Converted 112.00 MB image at 38.43 MB/s Nov 03 07:33:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2b6c5736-97e7-4ca2-a722-26c13181e79e 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:15 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2b6c5736-97e7-4ca2-a722-26c13181e79e 1G Nov 03 07:33:15 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:16 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2b6c5736-97e7-4ca2-a722-26c13181e79e 1G" returned: 0 in 0.490s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:16 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Downloaded image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb ((None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}])) to volume 2b6c5736-97e7-4ca2-a722-26c13181e79e successfully. {{(pid=87016) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 03 07:33:16 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Temporary image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb for user f1bce040bbaa4cb982926b22f9659532 is deleted. {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:33:16 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Marking volume 2b6c5736-97e7-4ca2-a722-26c13181e79e as bootable. {{(pid=87016) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 03 07:33:16 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Copying metadata from image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb to 2b6c5736-97e7-4ca2-a722-26c13181e79e. {{(pid=87016) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:33:16 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Creating volume glance metadata for volume 2b6c5736-97e7-4ca2-a722-26c13181e79e backed by image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87016) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:33:16 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e7726b-e9e4-4f36-ba99-0800c2955163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b6c5736-97e7-4ca2-a722-26c13181e79e', 'volume_size': 1, 'image_id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bde64ec799a64fc39c0407ed31a11129', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'created_at': datetime.datetime(2026, 11, 3, 6, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:16 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45de54ae-3d8b-43bf-a826-3850302aa525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:16 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Volume volume-2b6c5736-97e7-4ca2-a722-26c13181e79e (2b6c5736-97e7-4ca2-a722-26c13181e79e): created successfully Nov 03 07:33:16 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45de54ae-3d8b-43bf-a826-3850302aa525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:16 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Flow 'volume_create_manager' (84f22ad6-e2c2-416d-a93d-88586a5aa82c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:16 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-640508db-1aff-46e6-997c-c7abe3388900 tempest-VolumesImageMetadata-502021068 None] Created volume successfully. Nov 03 07:33:17 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-037199a4-1ea7-4243-a608-7344e9b60614 tempest-VolumesImageMetadata-502021068 None] Acquiring lock "cinder-2b6c5736-97e7-4ca2-a722-26c13181e79e-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:17 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-037199a4-1ea7-4243-a608-7344e9b60614 tempest-VolumesImageMetadata-502021068 None] Lock "cinder-2b6c5736-97e7-4ca2-a722-26c13181e79e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:17 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-037199a4-1ea7-4243-a608-7344e9b60614 tempest-VolumesImageMetadata-502021068 None] Acquiring lock "cinder-quobyte-2b6c5736-97e7-4ca2-a722-26c13181e79e" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:17 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-037199a4-1ea7-4243-a608-7344e9b60614 tempest-VolumesImageMetadata-502021068 None] Lock "cinder-quobyte-2b6c5736-97e7-4ca2-a722-26c13181e79e" acquired by "delete_volume" :: waited 0.019s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:17 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[61948987-05fd-4ff2-9070-1636dfbd0037]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-037199a4-1ea7-4243-a608-7344e9b60614 tempest-VolumesImageMetadata-502021068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2b6c5736-97e7-4ca2-a722-26c13181e79e {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:18 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2b6c5736-97e7-4ca2-a722-26c13181e79e Nov 03 07:33:18 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:18 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-037199a4-1ea7-4243-a608-7344e9b60614 tempest-VolumesImageMetadata-502021068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2b6c5736-97e7-4ca2-a722-26c13181e79e" returned: 0 in 0.598s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-037199a4-1ea7-4243-a608-7344e9b60614 tempest-VolumesImageMetadata-502021068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2b6c5736-97e7-4ca2-a722-26c13181e79e {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:18 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2b6c5736-97e7-4ca2-a722-26c13181e79e Nov 03 07:33:18 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:18 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-037199a4-1ea7-4243-a608-7344e9b60614 tempest-VolumesImageMetadata-502021068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2b6c5736-97e7-4ca2-a722-26c13181e79e" returned: 0 in 0.387s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:18 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-037199a4-1ea7-4243-a608-7344e9b60614 tempest-VolumesImageMetadata-502021068 None] Lock "cinder-quobyte-2b6c5736-97e7-4ca2-a722-26c13181e79e" released by "delete_volume" :: held 1.074s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:19 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-037199a4-1ea7-4243-a608-7344e9b60614 tempest-VolumesImageMetadata-502021068 None] Created reservations ['0f79c3c2-9c97-4038-9643-11252f74eb30', '060dcef8-3c6e-40ca-83ee-910263517868', 'cdbd8bc9-2b52-43f6-8b7b-56ce264f6c7c', '4ba88632-28a1-4310-8eec-84a7aa755e2a'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-037199a4-1ea7-4243-a608-7344e9b60614 tempest-VolumesImageMetadata-502021068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-037199a4-1ea7-4243-a608-7344e9b60614 tempest-VolumesImageMetadata-502021068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-037199a4-1ea7-4243-a608-7344e9b60614 tempest-VolumesImageMetadata-502021068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-037199a4-1ea7-4243-a608-7344e9b60614 tempest-VolumesImageMetadata-502021068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-037199a4-1ea7-4243-a608-7344e9b60614 tempest-VolumesImageMetadata-502021068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-037199a4-1ea7-4243-a608-7344e9b60614 tempest-VolumesImageMetadata-502021068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:19 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:33:19 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:19 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-037199a4-1ea7-4243-a608-7344e9b60614 tempest-VolumesImageMetadata-502021068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.384s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:19 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-037199a4-1ea7-4243-a608-7344e9b60614 tempest-VolumesImageMetadata-502021068 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:33:19 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-037199a4-1ea7-4243-a608-7344e9b60614 tempest-VolumesImageMetadata-502021068 None] Deleted volume successfully. Nov 03 07:33:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-037199a4-1ea7-4243-a608-7344e9b60614 tempest-VolumesImageMetadata-502021068 None] Lock "cinder-2b6c5736-97e7-4ca2-a722-26c13181e79e-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:20 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ece1d13c-bff8-4258-bed4-48e04f79449a tempest-GroupsV314Test-461489212 None] Group tempest-GroupsV314Test-Group-540103698: creating Nov 03 07:33:21 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ece1d13c-bff8-4258-bed4-48e04f79449a tempest-GroupsV314Test-461489212 None] Group tempest-GroupsV314Test-Group-540103698: created successfully Nov 03 07:33:21 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ece1d13c-bff8-4258-bed4-48e04f79449a tempest-GroupsV314Test-461489212 None] Create group completed successfully. Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Flow 'volume_create_manager' (871d4573-d327-45f6-824e-f14306f6751a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5c16bc-3130-4aad-8af2-756c2dfff20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5c16bc-3130-4aad-8af2-756c2dfff20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1786490426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=664592f9-b2a4-4ac2-87f5-11ffd7916b0b,host='devstack@QuobyteHD#QuobyteHD',id=760a17d4-751f-4536-af1d-5aea7c08b907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1ac889c407e45d0b98173d48e65697d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:23Z,use_quota=True,user_id='a907daf4ee154d42a88fd6039c864147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(094398fd-bc2d-404e-a16e-f42ecedb373a),volume_type_id=094398fd-bc2d-404e-a16e-f42ecedb373a)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b57057-43a1-4fb4-9238-d7a163c5528a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b57057-43a1-4fb4-9238-d7a163c5528a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6067335-a50b-4f5d-92f6-346dd3d7c9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6067335-a50b-4f5d-92f6-346dd3d7c9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '760a17d4-751f-4536-af1d-5aea7c08b907', 'volume_name': 'volume-760a17d4-751f-4536-af1d-5aea7c08b907', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92523267-fe09-4b4a-9c10-a9d0c6148cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92523267-fe09-4b4a-9c10-a9d0c6148cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba6fa3d-4c11-4689-8817-52fc8f42d809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:23 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Volume 760a17d4-751f-4536-af1d-5aea7c08b907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-760a17d4-751f-4536-af1d-5aea7c08b907', 'volume_size': 1} Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=664592f9-b2a4-4ac2-87f5-11ffd7916b0b,created_at=2026-11-03T06:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1786490426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=664592f9-b2a4-4ac2-87f5-11ffd7916b0b,host='devstack@QuobyteHD#QuobyteHD',id=760a17d4-751f-4536-af1d-5aea7c08b907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1ac889c407e45d0b98173d48e65697d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:23Z,use_quota=True,user_id='a907daf4ee154d42a88fd6039c864147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(094398fd-bc2d-404e-a16e-f42ecedb373a),volume_type_id=094398fd-bc2d-404e-a16e-f42ecedb373a)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Creating volume 760a17d4-751f-4536-af1d-5aea7c08b907 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:33:23 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:23 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907 1073741824 Nov 03 07:33:23 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:23 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907 1073741824" returned: 0 in 0.646s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:23 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907 Nov 03 07:33:23 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:24 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907" returned: 0 in 0.347s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba6fa3d-4c11-4689-8817-52fc8f42d809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-760a17d4-751f-4536-af1d-5aea7c08b907', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c99d8e9-86a5-414e-9fca-d16d1a526dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:24 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Volume volume-760a17d4-751f-4536-af1d-5aea7c08b907 (760a17d4-751f-4536-af1d-5aea7c08b907): created successfully Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c99d8e9-86a5-414e-9fca-d16d1a526dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Flow 'volume_create_manager' (871d4573-d327-45f6-824e-f14306f6751a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Flow 'volume_create_manager' (c8f8711b-fefc-4fcb-b6a2-7303e1d9b820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbeac18-3b10-472c-8fdb-ab6192d021e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:24 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-6fe320ab-a697-4bf2-9732-5ecc628906d2 tempest-GroupsV314Test-461489212 None] Created volume successfully. Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbeac18-3b10-472c-8fdb-ab6192d021e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-786134260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c4f774-2b77-4d46-b2d1-88f594a6f34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b2ba20c8d244a88f0587e4b179f0b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:24Z,use_quota=True,user_id='08360f94da284870b8011c0b2287b86d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f612a2a-4fbe-4b01-a3d1-a076b20a33a7),volume_type_id=5f612a2a-4fbe-4b01-a3d1-a076b20a33a7)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d4809b-fd25-41c9-899b-017a407ec76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d4809b-fd25-41c9-899b-017a407ec76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fce6cd5-8002-48ea-bf02-7de88c0b8d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fce6cd5-8002-48ea-bf02-7de88c0b8d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8c4f774-2b77-4d46-b2d1-88f594a6f34c', 'volume_name': 'volume-d8c4f774-2b77-4d46-b2d1-88f594a6f34c', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ded4bc-68c3-498e-b076-74566100b805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ded4bc-68c3-498e-b076-74566100b805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de3a626-be04-420e-be31-12f75d2845e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:24 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Volume d8c4f774-2b77-4d46-b2d1-88f594a6f34c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8c4f774-2b77-4d46-b2d1-88f594a6f34c', 'volume_size': 1} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-786134260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c4f774-2b77-4d46-b2d1-88f594a6f34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b2ba20c8d244a88f0587e4b179f0b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:24Z,use_quota=True,user_id='08360f94da284870b8011c0b2287b86d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f612a2a-4fbe-4b01-a3d1-a076b20a33a7),volume_type_id=5f612a2a-4fbe-4b01-a3d1-a076b20a33a7)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Creating volume d8c4f774-2b77-4d46-b2d1-88f594a6f34c {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:33:24 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:33:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8c4f774-2b77-4d46-b2d1-88f594a6f34c 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:24 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8c4f774-2b77-4d46-b2d1-88f594a6f34c 1073741824 Nov 03 07:33:24 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:24 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a7f6d4e0-9e5f-4e48-a3a2-bdd20ab206e6 tempest-GroupSnapshotsTest-1286634275 None] Group tempest-GroupSnapshotsTest-Group-1829764128: creating Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Flow 'volume_create_manager' (71e796f9-b15a-41b4-a5c4-96f32eec2f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3755884e-5f80-4d58-99be-15c536ea2873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3755884e-5f80-4d58-99be-15c536ea2873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-211454037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b2ba20c8d244a88f0587e4b179f0b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:25Z,use_quota=True,user_id='08360f94da284870b8011c0b2287b86d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb51731f-2685-4cf8-a36a-53ae612e0cb2),volume_type_id=fb51731f-2685-4cf8-a36a-53ae612e0cb2)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68855a5d-41b3-461a-86db-0a61c66d97f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68855a5d-41b3-461a-86db-0a61c66d97f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a71c6f-e7e6-46bf-981e-b2dc61e1845c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a71c6f-e7e6-46bf-981e-b2dc61e1845c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4', 'volume_name': 'volume-9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7bada9-c849-421b-a995-fd163dbf5723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7bada9-c849-421b-a995-fd163dbf5723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6537c9b7-43e4-4e7a-b4ec-ac82c7a41e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:25 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Volume 9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4', 'volume_size': 1} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:25 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:25 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a7f6d4e0-9e5f-4e48-a3a2-bdd20ab206e6 tempest-GroupSnapshotsTest-1286634275 None] Group tempest-GroupSnapshotsTest-Group-1829764128: created successfully Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8c4f774-2b77-4d46-b2d1-88f594a6f34c 1073741824" returned: 0 in 0.725s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:25 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a7f6d4e0-9e5f-4e48-a3a2-bdd20ab206e6 tempest-GroupSnapshotsTest-1286634275 None] Create group completed successfully. Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8c4f774-2b77-4d46-b2d1-88f594a6f34c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:25 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8c4f774-2b77-4d46-b2d1-88f594a6f34c Nov 03 07:33:25 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Flow 'volume_create_manager' (8d8fe411-80d8-49d8-9fcf-e27a23efc1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b41c2d9f-9752-4541-b3d0-838cda07d4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b41c2d9f-9752-4541-b3d0-838cda07d4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1109733957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a60b1c-59d2-4dce-b3e3-7d60b26afa7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b2ba20c8d244a88f0587e4b179f0b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:26Z,use_quota=True,user_id='08360f94da284870b8011c0b2287b86d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(caa45982-50a6-4694-a6bd-3a17aa4f2062),volume_type_id=caa45982-50a6-4694-a6bd-3a17aa4f2062)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549777ed-6077-4334-86b8-8b3bc773f335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:25 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549777ed-6077-4334-86b8-8b3bc773f335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc12be69-2bee-42fd-a0a0-326287a8afb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.image.glance [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Creating Keystone auth plugin from conf {{(pid=87016) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8c4f774-2b77-4d46-b2d1-88f594a6f34c" returned: 0 in 0.472s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.540s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-211454037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b2ba20c8d244a88f0587e4b179f0b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:25Z,use_quota=True,user_id='08360f94da284870b8011c0b2287b86d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb51731f-2685-4cf8-a36a-53ae612e0cb2),volume_type_id=fb51731f-2685-4cf8-a36a-53ae612e0cb2)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Creating volume 9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:33:25 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de3a626-be04-420e-be31-12f75d2845e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8c4f774-2b77-4d46-b2d1-88f594a6f34c', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a9d2b8-5791-469a-b723-dc1e90af878c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:25 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4 1073741824 Nov 03 07:33:25 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:25 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Volume volume-d8c4f774-2b77-4d46-b2d1-88f594a6f34c (d8c4f774-2b77-4d46-b2d1-88f594a6f34c): created successfully Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a9d2b8-5791-469a-b723-dc1e90af878c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Flow 'volume_create_manager' (c8f8711b-fefc-4fcb-b6a2-7303e1d9b820) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:25 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-aa0ff101-e0c6-42a6-b9d9-6fe470124893 tempest-TestInstancesWithCinderVolumes-719158012 None] Created volume successfully. Nov 03 07:33:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc12be69-2bee-42fd-a0a0-326287a8afb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '37a60b1c-59d2-4dce-b3e3-7d60b26afa7f', 'volume_name': 'volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f', 'volume_size': 1, 'image_id': '1169f295-3c9b-43cb-bc2e-70bfaa82a654', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1169f295-3c9b-43cb-bc2e-70bfaa82a654', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1684878480', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95b2ba20c8d244a88f0587e4b179f0b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1169f295-3c9b-43cb-bc2e-70bfaa82a654', 'created_at': datetime.datetime(2026, 11, 3, 6, 33, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 33, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1169f295-3c9b-43cb-bc2e-70bfaa82a654/file', 'properties': {}}, 'image_service': }' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25a7e8c-b6f5-47b5-b5aa-217540ce9bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25a7e8c-b6f5-47b5-b5aa-217540ce9bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39e592e5-88d5-44e4-94a9-9b00f7240ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:26 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Volume 37a60b1c-59d2-4dce-b3e3-7d60b26afa7f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f', 'volume_size': 1, 'image_id': '1169f295-3c9b-43cb-bc2e-70bfaa82a654', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1169f295-3c9b-43cb-bc2e-70bfaa82a654', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1684878480', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95b2ba20c8d244a88f0587e4b179f0b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1169f295-3c9b-43cb-bc2e-70bfaa82a654', 'created_at': datetime.datetime(2026, 11, 3, 6, 33, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 33, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1169f295-3c9b-43cb-bc2e-70bfaa82a654/file', 'properties': {}}, 'image_service': } Nov 03 07:33:26 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Trying to clone 37a60b1c-59d2-4dce-b3e3-7d60b26afa7f from image 1169f295-3c9b-43cb-bc2e-70bfaa82a654 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1169f295-3c9b-43cb-bc2e-70bfaa82a654', 'metadata': {}}]). {{(pid=87016) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:33:26 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4 1073741824" returned: 0 in 0.822s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:26 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:33:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Flow 'volume_create_manager' (6796ea87-ff37-415f-91a5-78f351584069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464cc0b3-6d81-47d5-9c66-993ecfc42356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464cc0b3-6d81-47d5-9c66-993ecfc42356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2120677112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8703bcda-7d33-4835-87b3-31e15076cafa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd39ad3a8b144e8c90c5310ede935169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:27Z,use_quota=True,user_id='5061539ced7048958a8bfd7f1f96324b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec1b09e-9769-4810-a7df-b343a0a2d1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec1b09e-9769-4810-a7df-b343a0a2d1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0595a8-6447-4e35-a11d-664cf1fa391e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0595a8-6447-4e35-a11d-664cf1fa391e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8703bcda-7d33-4835-87b3-31e15076cafa', 'volume_name': 'volume-8703bcda-7d33-4835-87b3-31e15076cafa', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85513733-49ce-445f-9cde-b07adf82703a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85513733-49ce-445f-9cde-b07adf82703a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab7dc240-5c2a-4c43-93e3-726da82e59ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:26 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Volume 8703bcda-7d33-4835-87b3-31e15076cafa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8703bcda-7d33-4835-87b3-31e15076cafa', 'volume_size': 1} Nov 03 07:33:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:26 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4 Nov 03 07:33:26 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:33:27 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Flow 'volume_create_manager' (77cc5830-3bba-47da-8255-0a7c8ce6f586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47bf0470-e6a1-4197-8f8b-726deccd2db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4" returned: 0 in 0.367s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.487s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:27 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Cloning volume 760a17d4-751f-4536-af1d-5aea7c08b907 to volume 9223ec53-0c34-45ad-a8ae-3e1eb18c6261 Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6537c9b7-43e4-4e7a-b4ec-ac82c7a41e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60ef559-9639-4ace-a5f7-1ab2d84bf4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47bf0470-e6a1-4197-8f8b-726deccd2db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-639711789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2e160dc-601f-4cd9-a550-853e88bcf948,host='devstack@QuobyteHD#QuobyteHD',id=4b75ee3d-0200-4482-9d72-e88da4f8df8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc32a96045304dcb8f916b642238b4a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:27Z,use_quota=True,user_id='72707c655e6743ac9d78a00c85b7e5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f5c6d86-4dbf-42d2-a896-767c3058dc33),volume_type_id=7f5c6d86-4dbf-42d2-a896-767c3058dc33)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ca914e2-74ce-4e91-a698-19f4d4b50b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ca914e2-74ce-4e91-a698-19f4d4b50b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe0656e6-4820-480d-bf2c-e02a4fdb6179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe0656e6-4820-480d-bf2c-e02a4fdb6179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b75ee3d-0200-4482-9d72-e88da4f8df8d', 'volume_name': 'volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (214b08d5-0d20-469e-84a5-a671cfb9297d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (214b08d5-0d20-469e-84a5-a671cfb9297d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77610f3d-36dc-4f08-bb63-a53022c6b6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:27 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Volume 4b75ee3d-0200-4482-9d72-e88da4f8df8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d', 'volume_size': 1} Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:27 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Volume volume-9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4 (9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4): created successfully Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60ef559-9639-4ace-a5f7-1ab2d84bf4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Flow 'volume_create_manager' (71e796f9-b15a-41b4-a5c4-96f32eec2f54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Creating offline snapshot afcef06f-5277-48ec-96e6-6b5111748841 of volume 760a17d4-751f-4536-af1d-5aea7c08b907 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:33:27 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-fea18810-e06a-4e3f-888c-f04c97729a77 tempest-TestInstancesWithCinderVolumes-719158012 None] Created volume successfully. Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a4ac1d-319a-4a54-9d26-0b963b390b9f]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:27 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907 Nov 03 07:33:27 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:27 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907" returned: 0 in 0.492s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.afcef06f-5277-48ec-96e6-6b5111748841 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:27 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.afcef06f-5277-48ec-96e6-6b5111748841 1G Nov 03 07:33:27 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:28 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.afcef06f-5277-48ec-96e6-6b5111748841 1G" returned: 0 in 0.467s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-760a17d4-751f-4536-af1d-5aea7c08b907 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.afcef06f-5277-48ec-96e6-6b5111748841 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:28 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-760a17d4-751f-4536-af1d-5aea7c08b907 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.afcef06f-5277-48ec-96e6-6b5111748841 Nov 03 07:33:28 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:28 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-760a17d4-751f-4536-af1d-5aea7c08b907 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.afcef06f-5277-48ec-96e6-6b5111748841" returned: 0 in 0.344s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:28 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.afcef06f-5277-48ec-96e6-6b5111748841 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:33:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.afcef06f-5277-48ec-96e6-6b5111748841 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:28 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.afcef06f-5277-48ec-96e6-6b5111748841 Nov 03 07:33:28 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:28 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.afcef06f-5277-48ec-96e6-6b5111748841" returned: 0 in 0.341s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:29 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.info Nov 03 07:33:29 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:29 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.info" returned: 0 in 0.312s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:29 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:33:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:29 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.info Nov 03 07:33:29 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:29 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.info" returned: 0 in 0.276s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Acquiring lock "cinder-quobyte-9223ec53-0c34-45ad-a8ae-3e1eb18c6261" by "_copy_volume_from_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Lock "cinder-quobyte-9223ec53-0c34-45ad-a8ae-3e1eb18c6261" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] snapshot: afcef06f-5277-48ec-96e6-6b5111748841, volume: 9223ec53-0c34-45ad-a8ae-3e1eb18c6261, {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:33:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:29 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99b4387-60ac-4145-b715-5fa6ddc9b679]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.afcef06f-5277-48ec-96e6-6b5111748841 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:29 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.afcef06f-5277-48ec-96e6-6b5111748841 Nov 03 07:33:29 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:30 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.afcef06f-5277-48ec-96e6-6b5111748841" returned: 0 in 0.427s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-760a17d4-751f-4536-af1d-5aea7c08b907(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:33:30 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[7236f171-3eaa-4c9b-b1dc-efe1947e1bff]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:30 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907 Nov 03 07:33:30 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:30 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907" returned: 0 in 0.413s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907 {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:33:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Creating direct copy from snapshot {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:33:30 devstack cinder-volume[87016]: DEBUG cinder.utils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Path /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9223ec53-0c34-45ad-a8ae-3e1eb18c6261 not found in is_blk_device check {{(pid=87016) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 07:33:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9223ec53-0c34-45ad-a8ae-3e1eb18c6261 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:30 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9223ec53-0c34-45ad-a8ae-3e1eb18c6261 Nov 03 07:33:30 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:30 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1169f295-3c9b-43cb-bc2e-70bfaa82a654_eae6ynr_devstack@QuobyteHD, size 20.69 MB, duration 4.22 sec {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:33:30 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Image download 20.69 MB at 4.91 MB/s Nov 03 07:33:30 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd2c67b-b803-4560-ab44-f25395bd78fd]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1169f295-3c9b-43cb-bc2e-70bfaa82a654_eae6ynr_devstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:30 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1169f295-3c9b-43cb-bc2e-70bfaa82a654_eae6ynr_devstack@QuobyteHD Nov 03 07:33:30 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:31 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1169f295-3c9b-43cb-bc2e-70bfaa82a654_eae6ynr_devstack@QuobyteHD" returned: 0 in 0.471s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:31 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Temporary image 1169f295-3c9b-43cb-bc2e-70bfaa82a654 is fetched for user 08360f94da284870b8011c0b2287b86d. {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:33:31 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56c5b87-db11-4fa4-b014-ccfdc0e74c84]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1169f295-3c9b-43cb-bc2e-70bfaa82a654_eae6ynr_devstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:31 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1169f295-3c9b-43cb-bc2e-70bfaa82a654_eae6ynr_devstack@QuobyteHD Nov 03 07:33:31 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:32 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1169f295-3c9b-43cb-bc2e-70bfaa82a654_eae6ynr_devstack@QuobyteHD" returned: 0 in 0.661s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:37 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9223ec53-0c34-45ad-a8ae-3e1eb18c6261" returned: 0 in 6.524s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:37 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Image conversion details: src /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907, size 1024.00 MB, duration 6.53 sec, destination /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9223ec53-0c34-45ad-a8ae-3e1eb18c6261 {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:33:37 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Converted 1024.00 MB image at 156.93 MB/s Nov 03 07:33:37 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9223ec53-0c34-45ad-a8ae-3e1eb18c6261 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:33:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9223ec53-0c34-45ad-a8ae-3e1eb18c6261 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:37 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9223ec53-0c34-45ad-a8ae-3e1eb18c6261 Nov 03 07:33:37 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:37 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9223ec53-0c34-45ad-a8ae-3e1eb18c6261" returned: 0 in 0.243s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Lock "cinder-quobyte-9223ec53-0c34-45ad-a8ae-3e1eb18c6261" released by "_copy_volume_from_snapshot" :: held 7.685s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Acquiring lock "cinder-quobyte-afcef06f-5277-48ec-96e6-6b5111748841" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Lock "cinder-quobyte-afcef06f-5277-48ec-96e6-6b5111748841" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:37 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Deleting offline snapshot afcef06f-5277-48ec-96e6-6b5111748841 of volume 760a17d4-751f-4536-af1d-5aea7c08b907 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:33:37 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] snapshot_file for this snap is: volume-760a17d4-751f-4536-af1d-5aea7c08b907.afcef06f-5277-48ec-96e6-6b5111748841 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:33:37 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a7d1af-8ce9-46bd-9ac2-9bc60e40b8bd]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.afcef06f-5277-48ec-96e6-6b5111748841 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:37 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.afcef06f-5277-48ec-96e6-6b5111748841 Nov 03 07:33:37 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:37 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.afcef06f-5277-48ec-96e6-6b5111748841" returned: 0 in 0.414s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:37 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-760a17d4-751f-4536-af1d-5aea7c08b907(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:33:37 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6061d2b-8c45-484f-a409-b6f6f20a86a2]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:38 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907 Nov 03 07:33:38 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:38 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907" returned: 0 in 0.526s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.afcef06f-5277-48ec-96e6-6b5111748841 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:38 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.afcef06f-5277-48ec-96e6-6b5111748841 Nov 03 07:33:38 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:38 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.afcef06f-5277-48ec-96e6-6b5111748841" returned: 0 in 0.320s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.afcef06f-5277-48ec-96e6-6b5111748841 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:38 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.afcef06f-5277-48ec-96e6-6b5111748841 Nov 03 07:33:38 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:39 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907.afcef06f-5277-48ec-96e6-6b5111748841" returned: 0 in 0.316s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Lock "cinder-quobyte-afcef06f-5277-48ec-96e6-6b5111748841" released by "_delete_snapshot" :: held 1.680s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.946s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.340s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2120677112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8703bcda-7d33-4835-87b3-31e15076cafa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd39ad3a8b144e8c90c5310ede935169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:27Z,use_quota=True,user_id='5061539ced7048958a8bfd7f1f96324b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Creating volume 8703bcda-7d33-4835-87b3-31e15076cafa {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:33:39 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:39 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa 1073741824 Nov 03 07:33:39 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:39 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a087e21c-3334-4885-9f12-192b39efd393 tempest-GroupsV314Test-461489212 None] Create group from source-group-664592f9-b2a4-4ac2-87f5-11ffd7916b0b completed successfully. Nov 03 07:33:39 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa 1073741824" returned: 0 in 0.455s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:39 devstack sudo[98076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa Nov 03 07:33:39 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:39 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa" returned: 0 in 0.278s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.651s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d2e160dc-601f-4cd9-a550-853e88bcf948,created_at=2026-11-03T06:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-639711789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2e160dc-601f-4cd9-a550-853e88bcf948,host='devstack@QuobyteHD#QuobyteHD',id=4b75ee3d-0200-4482-9d72-e88da4f8df8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc32a96045304dcb8f916b642238b4a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:27Z,use_quota=True,user_id='72707c655e6743ac9d78a00c85b7e5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f5c6d86-4dbf-42d2-a896-767c3058dc33),volume_type_id=7f5c6d86-4dbf-42d2-a896-767c3058dc33)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Creating volume 4b75ee3d-0200-4482-9d72-e88da4f8df8d {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:33:39 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab7dc240-5c2a-4c43-93e3-726da82e59ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8703bcda-7d33-4835-87b3-31e15076cafa', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:39 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d 1073741824 Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae433a9-953e-43ba-9e81-409ce22b32f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:39 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:39 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Volume volume-8703bcda-7d33-4835-87b3-31e15076cafa (8703bcda-7d33-4835-87b3-31e15076cafa): created successfully Nov 03 07:33:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae433a9-953e-43ba-9e81-409ce22b32f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Flow 'volume_create_manager' (6796ea87-ff37-415f-91a5-78f351584069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:40 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-5e9fc7f5-30e4-47d5-bc17-415108a74fea tempest-SnapshotMetadataTestJSON-1447486369 None] Created volume successfully. Nov 03 07:33:40 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d 1073741824" returned: 0 in 0.549s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:40 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d Nov 03 07:33:40 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d183c9f4-d944-4db9-bf61-38b71a51f1e7 tempest-GroupsV314Test-461489212 None] Acquiring lock "cinder-quobyte-9223ec53-0c34-45ad-a8ae-3e1eb18c6261" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d183c9f4-d944-4db9-bf61-38b71a51f1e7 tempest-GroupsV314Test-461489212 None] Lock "cinder-quobyte-9223ec53-0c34-45ad-a8ae-3e1eb18c6261" acquired by "delete_volume" :: waited 0.025s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:40 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d" returned: 0 in 0.312s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.765s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1109733957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a60b1c-59d2-4dce-b3e3-7d60b26afa7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b2ba20c8d244a88f0587e4b179f0b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:26Z,use_quota=True,user_id='08360f94da284870b8011c0b2287b86d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(caa45982-50a6-4694-a6bd-3a17aa4f2062),volume_type_id=caa45982-50a6-4694-a6bd-3a17aa4f2062)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Creating volume 37a60b1c-59d2-4dce-b3e3-7d60b26afa7f {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:33:40 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[61661a2d-c1d6-41ae-88eb-8f678c7ef36d]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d183c9f4-d944-4db9-bf61-38b71a51f1e7 tempest-GroupsV314Test-461489212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9223ec53-0c34-45ad-a8ae-3e1eb18c6261 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:40 devstack sudo[98089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f 1073741824 Nov 03 07:33:40 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77610f3d-36dc-4f08-bb63-a53022c6b6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (044de3d2-b4ea-4f45-9ca8-fcf1e3de8ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:40 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Volume volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d (4b75ee3d-0200-4482-9d72-e88da4f8df8d): created successfully Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (044de3d2-b4ea-4f45-9ca8-fcf1e3de8ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Flow 'volume_create_manager' (77cc5830-3bba-47da-8255-0a7c8ce6f586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:41 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9223ec53-0c34-45ad-a8ae-3e1eb18c6261 Nov 03 07:33:41 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:41 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b9eecd14-f080-4299-ae16-cff291038e34 tempest-GroupSnapshotsTest-1286634275 None] Created volume successfully. Nov 03 07:33:41 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d183c9f4-d944-4db9-bf61-38b71a51f1e7 tempest-GroupsV314Test-461489212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9223ec53-0c34-45ad-a8ae-3e1eb18c6261" returned: 0 in 0.533s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d183c9f4-d944-4db9-bf61-38b71a51f1e7 tempest-GroupsV314Test-461489212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9223ec53-0c34-45ad-a8ae-3e1eb18c6261 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:41 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9223ec53-0c34-45ad-a8ae-3e1eb18c6261 Nov 03 07:33:41 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:41 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f 1073741824" returned: 0 in 0.627s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:41 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f Nov 03 07:33:41 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c1af5269-25e9-417b-98b3-f5b9c3f68ecd tempest-SnapshotMetadataTestJSON-1447486369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:41 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d183c9f4-d944-4db9-bf61-38b71a51f1e7 tempest-GroupsV314Test-461489212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9223ec53-0c34-45ad-a8ae-3e1eb18c6261" returned: 0 in 0.370s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:41 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d183c9f4-d944-4db9-bf61-38b71a51f1e7 tempest-GroupsV314Test-461489212 None] Lock "cinder-quobyte-9223ec53-0c34-45ad-a8ae-3e1eb18c6261" released by "delete_volume" :: held 0.991s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:41 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f" returned: 0 in 0.313s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:41 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:33:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c1af5269-25e9-417b-98b3-f5b9c3f68ecd tempest-SnapshotMetadataTestJSON-1447486369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.275s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:41 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-c1af5269-25e9-417b-98b3-f5b9c3f68ecd tempest-SnapshotMetadataTestJSON-1447486369 None] Creating offline snapshot 0254d2ca-37c9-44f3-a1aa-505061aab5a8 of volume 8703bcda-7d33-4835-87b3-31e15076cafa {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:33:41 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-d183c9f4-d944-4db9-bf61-38b71a51f1e7 tempest-GroupsV314Test-461489212 None] Created reservations ['770927a6-6e47-49c4-beaa-79f99973b70b'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:41 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Attempting download of 1169f295-3c9b-43cb-bc2e-70bfaa82a654 ((None, [{'url': 'file:///opt/stack/data/glance/images/1169f295-3c9b-43cb-bc2e-70bfaa82a654', 'metadata': {}}])) to volume 37a60b1c-59d2-4dce-b3e3-7d60b26afa7f. {{(pid=87016) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 03 07:33:41 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[a924da4c-d352-44a2-83f0-d00b1c635eef]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1af5269-25e9-417b-98b3-f5b9c3f68ecd tempest-SnapshotMetadataTestJSON-1447486369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:41 devstack cinder-volume[87016]: WARNING cinder.quota [None req-d183c9f4-d944-4db9-bf61-38b71a51f1e7 tempest-GroupsV314Test-461489212 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2105501151 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2105501151, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:33:41 devstack cinder-volume[87016]: WARNING cinder.quota [None req-d183c9f4-d944-4db9-bf61-38b71a51f1e7 tempest-GroupsV314Test-461489212 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2105501151 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2105501151, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:33:41 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[52112a86-2ce1-4603-8f46-e1c55eeb41d7]: (4, 'raw') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1169f295-3c9b-43cb-bc2e-70bfaa82a654_e7sefzyq {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:42 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-d183c9f4-d944-4db9-bf61-38b71a51f1e7 tempest-GroupsV314Test-461489212 None] Created reservations ['97f5251c-98ab-47eb-a1e0-a835e5ceb04e', 'd877b890-8899-43c6-b3fe-01a910647729', 'ba567ae7-e2e7-4b55-90e6-39bfd234ef5a', '17a9cb84-9518-4b3f-b5b7-21763cf49223'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:42 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa Nov 03 07:33:42 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:42 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1169f295-3c9b-43cb-bc2e-70bfaa82a654_e7sefzyq Nov 03 07:33:42 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:42 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-5131eb96-5b91-48ad-95fc-fce13b85432d tempest-GroupSnapshotsTest-1286634275 None] GroupSnapshot 4a8758d0-2150-4822-a5c3-c318f73b9ea6: creating. Nov 03 07:33:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5131eb96-5b91-48ad-95fc-fce13b85432d tempest-GroupSnapshotsTest-1286634275 None] Group snapshot 4a8758d0-2150-4822-a5c3-c318f73b9ea6: creating. {{(pid=87016) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 07:33:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5131eb96-5b91-48ad-95fc-fce13b85432d tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d183c9f4-d944-4db9-bf61-38b71a51f1e7 tempest-GroupsV314Test-461489212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d183c9f4-d944-4db9-bf61-38b71a51f1e7 tempest-GroupsV314Test-461489212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d183c9f4-d944-4db9-bf61-38b71a51f1e7 tempest-GroupsV314Test-461489212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d183c9f4-d944-4db9-bf61-38b71a51f1e7 tempest-GroupsV314Test-461489212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d183c9f4-d944-4db9-bf61-38b71a51f1e7 tempest-GroupsV314Test-461489212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d183c9f4-d944-4db9-bf61-38b71a51f1e7 tempest-GroupsV314Test-461489212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:42 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:33:42 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:42 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1af5269-25e9-417b-98b3-f5b9c3f68ecd tempest-SnapshotMetadataTestJSON-1447486369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa" returned: 0 in 0.588s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1af5269-25e9-417b-98b3-f5b9c3f68ecd tempest-SnapshotMetadataTestJSON-1447486369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.0254d2ca-37c9-44f3-a1aa-505061aab5a8 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:42 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.0254d2ca-37c9-44f3-a1aa-505061aab5a8 1G Nov 03 07:33:42 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:42 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1169f295-3c9b-43cb-bc2e-70bfaa82a654_e7sefzyq" returned: 0 in 0.603s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1169f295-3c9b-43cb-bc2e-70bfaa82a654_e7sefzyq {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:42 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d183c9f4-d944-4db9-bf61-38b71a51f1e7 tempest-GroupsV314Test-461489212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.381s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:42 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-d183c9f4-d944-4db9-bf61-38b71a51f1e7 tempest-GroupsV314Test-461489212 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:33:42 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-d183c9f4-d944-4db9-bf61-38b71a51f1e7 tempest-GroupsV314Test-461489212 None] Delete group completed successfully. Nov 03 07:33:42 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1169f295-3c9b-43cb-bc2e-70bfaa82a654_e7sefzyq Nov 03 07:33:42 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:43 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1af5269-25e9-417b-98b3-f5b9c3f68ecd tempest-SnapshotMetadataTestJSON-1447486369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.0254d2ca-37c9-44f3-a1aa-505061aab5a8 1G" returned: 0 in 0.498s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1af5269-25e9-417b-98b3-f5b9c3f68ecd tempest-SnapshotMetadataTestJSON-1447486369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8703bcda-7d33-4835-87b3-31e15076cafa -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.0254d2ca-37c9-44f3-a1aa-505061aab5a8 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:43 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1169f295-3c9b-43cb-bc2e-70bfaa82a654_e7sefzyq" returned: 1 in 0.422s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1169f295-3c9b-43cb-bc2e-70bfaa82a654_e7sefzyq' failed. Not Retrying. {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:33:43 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[1beaca14-3f0a-45c6-9ec5-78ec6c04fc69]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1169f295-3c9b-43cb-bc2e-70bfaa82a654_eae6ynr_devstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:43 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8703bcda-7d33-4835-87b3-31e15076cafa -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.0254d2ca-37c9-44f3-a1aa-505061aab5a8 Nov 03 07:33:43 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:43 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1169f295-3c9b-43cb-bc2e-70bfaa82a654_eae6ynr_devstack@QuobyteHD Nov 03 07:33:43 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:43 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1af5269-25e9-417b-98b3-f5b9c3f68ecd tempest-SnapshotMetadataTestJSON-1447486369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8703bcda-7d33-4835-87b3-31e15076cafa -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.0254d2ca-37c9-44f3-a1aa-505061aab5a8" returned: 0 in 0.324s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:43 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-c1af5269-25e9-417b-98b3-f5b9c3f68ecd tempest-SnapshotMetadataTestJSON-1447486369 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.0254d2ca-37c9-44f3-a1aa-505061aab5a8 is being set with open permissions: ugo+rw Nov 03 07:33:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1af5269-25e9-417b-98b3-f5b9c3f68ecd tempest-SnapshotMetadataTestJSON-1447486369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.0254d2ca-37c9-44f3-a1aa-505061aab5a8 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:43 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.0254d2ca-37c9-44f3-a1aa-505061aab5a8 Nov 03 07:33:43 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:43 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1169f295-3c9b-43cb-bc2e-70bfaa82a654_eae6ynr_devstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:43 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] 1169f295-3c9b-43cb-bc2e-70bfaa82a654 was qcow2, converting to qcow2 {{(pid=87016) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:33:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1169f295-3c9b-43cb-bc2e-70bfaa82a654_eae6ynr_devstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:43 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1169f295-3c9b-43cb-bc2e-70bfaa82a654_eae6ynr_devstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f Nov 03 07:33:43 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:43 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1af5269-25e9-417b-98b3-f5b9c3f68ecd tempest-SnapshotMetadataTestJSON-1447486369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.0254d2ca-37c9-44f3-a1aa-505061aab5a8" returned: 0 in 0.354s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1f415075-6bf1-4b03-806b-44bdc1e6b3d9 tempest-GroupsV314Test-461489212 None] Acquiring lock "cinder-quobyte-760a17d4-751f-4536-af1d-5aea7c08b907" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1af5269-25e9-417b-98b3-f5b9c3f68ecd tempest-SnapshotMetadataTestJSON-1447486369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1f415075-6bf1-4b03-806b-44bdc1e6b3d9 tempest-GroupsV314Test-461489212 None] Lock "cinder-quobyte-760a17d4-751f-4536-af1d-5aea7c08b907" acquired by "delete_volume" :: waited 0.040s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:43 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.info Nov 03 07:33:43 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:43 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7c3263-d558-4858-aa02-382cb1dd15f0]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1f415075-6bf1-4b03-806b-44bdc1e6b3d9 tempest-GroupsV314Test-461489212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:44 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907 Nov 03 07:33:44 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:44 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1af5269-25e9-417b-98b3-f5b9c3f68ecd tempest-SnapshotMetadataTestJSON-1447486369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.info" returned: 0 in 0.390s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:44 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-c1af5269-25e9-417b-98b3-f5b9c3f68ecd tempest-SnapshotMetadataTestJSON-1447486369 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.info is being set with open permissions: ugo+rw Nov 03 07:33:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1af5269-25e9-417b-98b3-f5b9c3f68ecd tempest-SnapshotMetadataTestJSON-1447486369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:44 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.info Nov 03 07:33:44 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:44 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1f415075-6bf1-4b03-806b-44bdc1e6b3d9 tempest-GroupsV314Test-461489212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907" returned: 0 in 0.568s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1f415075-6bf1-4b03-806b-44bdc1e6b3d9 tempest-GroupsV314Test-461489212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:44 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907 Nov 03 07:33:44 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:44 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c1af5269-25e9-417b-98b3-f5b9c3f68ecd tempest-SnapshotMetadataTestJSON-1447486369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.info" returned: 0 in 0.322s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c1af5269-25e9-417b-98b3-f5b9c3f68ecd tempest-SnapshotMetadataTestJSON-1447486369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.709s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5131eb96-5b91-48ad-95fc-fce13b85432d tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.315s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-5131eb96-5b91-48ad-95fc-fce13b85432d tempest-GroupSnapshotsTest-1286634275 None] Creating offline snapshot 5d59bf29-c20d-4538-a128-1e94e2170b60 of volume 4b75ee3d-0200-4482-9d72-e88da4f8df8d {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:33:44 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-c1af5269-25e9-417b-98b3-f5b9c3f68ecd tempest-SnapshotMetadataTestJSON-1447486369 None] Create snapshot completed successfully Nov 03 07:33:44 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[e993b787-0639-4af3-8b30-bdcd1afc8eb0]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5131eb96-5b91-48ad-95fc-fce13b85432d tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:44 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1f415075-6bf1-4b03-806b-44bdc1e6b3d9 tempest-GroupsV314Test-461489212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-760a17d4-751f-4536-af1d-5aea7c08b907" returned: 0 in 0.325s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1f415075-6bf1-4b03-806b-44bdc1e6b3d9 tempest-GroupsV314Test-461489212 None] Lock "cinder-quobyte-760a17d4-751f-4536-af1d-5aea7c08b907" released by "delete_volume" :: held 0.981s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:44 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d Nov 03 07:33:44 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:44 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-1f415075-6bf1-4b03-806b-44bdc1e6b3d9 tempest-GroupsV314Test-461489212 None] Created reservations ['eb1c7e48-5509-4f1a-b4a7-ca3c9daaa5b6'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:44 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-1f415075-6bf1-4b03-806b-44bdc1e6b3d9 tempest-GroupsV314Test-461489212 None] Created reservations ['2481b067-12c9-4da0-b0f6-782ec4fe746c', '5bbe3c5c-ff07-45b1-a3af-e2d59c10707a', '0027c8ee-0ca0-46ea-bfb8-ed464f30749b', 'eead8624-076a-4c05-b30e-d1aa0bde53d8'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1f415075-6bf1-4b03-806b-44bdc1e6b3d9 tempest-GroupsV314Test-461489212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1f415075-6bf1-4b03-806b-44bdc1e6b3d9 tempest-GroupsV314Test-461489212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:45 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1f415075-6bf1-4b03-806b-44bdc1e6b3d9 tempest-GroupsV314Test-461489212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:45 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1f415075-6bf1-4b03-806b-44bdc1e6b3d9 tempest-GroupsV314Test-461489212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1f415075-6bf1-4b03-806b-44bdc1e6b3d9 tempest-GroupsV314Test-461489212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1f415075-6bf1-4b03-806b-44bdc1e6b3d9 tempest-GroupsV314Test-461489212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:45 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:33:45 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:45 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5131eb96-5b91-48ad-95fc-fce13b85432d tempest-GroupSnapshotsTest-1286634275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d" returned: 0 in 0.761s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5131eb96-5b91-48ad-95fc-fce13b85432d tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.5d59bf29-c20d-4538-a128-1e94e2170b60 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:45 devstack sudo[98172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.5d59bf29-c20d-4538-a128-1e94e2170b60 1G Nov 03 07:33:45 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:45 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1f415075-6bf1-4b03-806b-44bdc1e6b3d9 tempest-GroupsV314Test-461489212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.477s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:45 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-1f415075-6bf1-4b03-806b-44bdc1e6b3d9 tempest-GroupsV314Test-461489212 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:33:45 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-1f415075-6bf1-4b03-806b-44bdc1e6b3d9 tempest-GroupsV314Test-461489212 None] Delete group completed successfully. Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bf1f49b4-6179-4503-9d38-7e778f1b5425 tempest-SnapshotMetadataTestJSON-1447486369 None] Acquiring lock "cinder-0254d2ca-37c9-44f3-a1aa-505061aab5a8-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bf1f49b4-6179-4503-9d38-7e778f1b5425 tempest-SnapshotMetadataTestJSON-1447486369 None] Lock "cinder-0254d2ca-37c9-44f3-a1aa-505061aab5a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bf1f49b4-6179-4503-9d38-7e778f1b5425 tempest-SnapshotMetadataTestJSON-1447486369 None] Acquiring lock "cinder-quobyte-8703bcda-7d33-4835-87b3-31e15076cafa" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bf1f49b4-6179-4503-9d38-7e778f1b5425 tempest-SnapshotMetadataTestJSON-1447486369 None] Lock "cinder-quobyte-8703bcda-7d33-4835-87b3-31e15076cafa" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bf1f49b4-6179-4503-9d38-7e778f1b5425 tempest-SnapshotMetadataTestJSON-1447486369 None] Acquiring lock "cinder-quobyte-0254d2ca-37c9-44f3-a1aa-505061aab5a8" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bf1f49b4-6179-4503-9d38-7e778f1b5425 tempest-SnapshotMetadataTestJSON-1447486369 None] Lock "cinder-quobyte-0254d2ca-37c9-44f3-a1aa-505061aab5a8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-bf1f49b4-6179-4503-9d38-7e778f1b5425 tempest-SnapshotMetadataTestJSON-1447486369 None] Deleting offline snapshot 0254d2ca-37c9-44f3-a1aa-505061aab5a8 of volume 8703bcda-7d33-4835-87b3-31e15076cafa {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:33:46 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-bf1f49b4-6179-4503-9d38-7e778f1b5425 tempest-SnapshotMetadataTestJSON-1447486369 None] snapshot_file for this snap is: volume-8703bcda-7d33-4835-87b3-31e15076cafa.0254d2ca-37c9-44f3-a1aa-505061aab5a8 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1169f295-3c9b-43cb-bc2e-70bfaa82a654_eae6ynr_devstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f" returned: 0 in 2.781s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1169f295-3c9b-43cb-bc2e-70bfaa82a654_eae6ynr_devstack@QuobyteHD, size 112.00 MB, duration 2.78 sec, destination /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:33:46 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Converted 112.00 MB image at 40.25 MB/s Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[8856580a-7964-4062-9573-37abca5fcca0]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:46 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bf1f49b4-6179-4503-9d38-7e778f1b5425 tempest-SnapshotMetadataTestJSON-1447486369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.0254d2ca-37c9-44f3-a1aa-505061aab5a8 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5131eb96-5b91-48ad-95fc-fce13b85432d tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.5d59bf29-c20d-4538-a128-1e94e2170b60 1G" returned: 0 in 0.848s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5131eb96-5b91-48ad-95fc-fce13b85432d tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.5d59bf29-c20d-4538-a128-1e94e2170b60 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:46 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f 1G Nov 03 07:33:46 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:46 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.5d59bf29-c20d-4538-a128-1e94e2170b60 Nov 03 07:33:46 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:46 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.0254d2ca-37c9-44f3-a1aa-505061aab5a8 Nov 03 07:33:46 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:46 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5131eb96-5b91-48ad-95fc-fce13b85432d tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.5d59bf29-c20d-4538-a128-1e94e2170b60" returned: 0 in 0.390s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:46 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-5131eb96-5b91-48ad-95fc-fce13b85432d tempest-GroupSnapshotsTest-1286634275 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.5d59bf29-c20d-4538-a128-1e94e2170b60 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5131eb96-5b91-48ad-95fc-fce13b85432d tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.5d59bf29-c20d-4538-a128-1e94e2170b60 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:46 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.5d59bf29-c20d-4538-a128-1e94e2170b60 Nov 03 07:33:46 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:46 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f 1G" returned: 0 in 0.508s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Downloaded image 1169f295-3c9b-43cb-bc2e-70bfaa82a654 ((None, [{'url': 'file:///opt/stack/data/glance/images/1169f295-3c9b-43cb-bc2e-70bfaa82a654', 'metadata': {}}])) to volume 37a60b1c-59d2-4dce-b3e3-7d60b26afa7f successfully. {{(pid=87016) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Temporary image 1169f295-3c9b-43cb-bc2e-70bfaa82a654 for user 08360f94da284870b8011c0b2287b86d is deleted. {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Marking volume 37a60b1c-59d2-4dce-b3e3-7d60b26afa7f as bootable. {{(pid=87016) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:UPDATE=82,cinder:DELETE=5,cinder:SELECT=85,cinder:INSERT=25 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Copying metadata from image 1169f295-3c9b-43cb-bc2e-70bfaa82a654 to 37a60b1c-59d2-4dce-b3e3-7d60b26afa7f. {{(pid=87016) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Creating volume glance metadata for volume 37a60b1c-59d2-4dce-b3e3-7d60b26afa7f backed by image 1169f295-3c9b-43cb-bc2e-70bfaa82a654 with: {'image_id': '1169f295-3c9b-43cb-bc2e-70bfaa82a654', 'image_name': 'tempest-scenario-img--1684878480', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87016) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=69,cinder:UPDATE=81,cinder:INSERT=26,cinder:DELETE=6 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:33:46 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39e592e5-88d5-44e4-94a9-9b00f7240ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f', 'volume_size': 1, 'image_id': '1169f295-3c9b-43cb-bc2e-70bfaa82a654', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1169f295-3c9b-43cb-bc2e-70bfaa82a654', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1684878480', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95b2ba20c8d244a88f0587e4b179f0b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1169f295-3c9b-43cb-bc2e-70bfaa82a654', 'created_at': datetime.datetime(2026, 11, 3, 6, 33, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 33, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1169f295-3c9b-43cb-bc2e-70bfaa82a654/file', 'properties': {}}, 'image_service': }' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (244ebc1c-3a45-43a5-ac53-09a3e5c5aa11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bf1f49b4-6179-4503-9d38-7e778f1b5425 tempest-SnapshotMetadataTestJSON-1447486369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.0254d2ca-37c9-44f3-a1aa-505061aab5a8" returned: 0 in 0.670s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-bf1f49b4-6179-4503-9d38-7e778f1b5425 tempest-SnapshotMetadataTestJSON-1447486369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8703bcda-7d33-4835-87b3-31e15076cafa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:33:46 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Volume volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f (37a60b1c-59d2-4dce-b3e3-7d60b26afa7f): created successfully Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (244ebc1c-3a45-43a5-ac53-09a3e5c5aa11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Flow 'volume_create_manager' (8d8fe411-80d8-49d8-9fcf-e27a23efc1e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e14b2ad-7dfe-47c7-b95a-ace1a0388567]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bf1f49b4-6179-4503-9d38-7e778f1b5425 tempest-SnapshotMetadataTestJSON-1447486369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:47 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-9cc8590a-db13-46b3-acbd-b5d6a8058e3f tempest-TestInstancesWithCinderVolumes-719158012 None] Created volume successfully. Nov 03 07:33:47 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5131eb96-5b91-48ad-95fc-fce13b85432d tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.5d59bf29-c20d-4538-a128-1e94e2170b60" returned: 0 in 0.398s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5131eb96-5b91-48ad-95fc-fce13b85432d tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:47 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.info Nov 03 07:33:47 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:47 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa Nov 03 07:33:47 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:47 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5131eb96-5b91-48ad-95fc-fce13b85432d tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.info" returned: 0 in 0.302s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:47 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-5131eb96-5b91-48ad-95fc-fce13b85432d tempest-GroupSnapshotsTest-1286634275 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:33:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5131eb96-5b91-48ad-95fc-fce13b85432d tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:47 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.info Nov 03 07:33:47 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:47 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bf1f49b4-6179-4503-9d38-7e778f1b5425 tempest-SnapshotMetadataTestJSON-1447486369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa" returned: 0 in 0.555s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bf1f49b4-6179-4503-9d38-7e778f1b5425 tempest-SnapshotMetadataTestJSON-1447486369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.0254d2ca-37c9-44f3-a1aa-505061aab5a8 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:47 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.0254d2ca-37c9-44f3-a1aa-505061aab5a8 Nov 03 07:33:47 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:47 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5131eb96-5b91-48ad-95fc-fce13b85432d tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.info" returned: 0 in 0.327s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5131eb96-5b91-48ad-95fc-fce13b85432d tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.171s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:47 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-5131eb96-5b91-48ad-95fc-fce13b85432d tempest-GroupSnapshotsTest-1286634275 None] group_snapshot 4a8758d0-2150-4822-a5c3-c318f73b9ea6: created successfully Nov 03 07:33:48 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bf1f49b4-6179-4503-9d38-7e778f1b5425 tempest-SnapshotMetadataTestJSON-1447486369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.0254d2ca-37c9-44f3-a1aa-505061aab5a8" returned: 0 in 0.482s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bf1f49b4-6179-4503-9d38-7e778f1b5425 tempest-SnapshotMetadataTestJSON-1447486369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.0254d2ca-37c9-44f3-a1aa-505061aab5a8 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:48 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.0254d2ca-37c9-44f3-a1aa-505061aab5a8 Nov 03 07:33:48 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:48 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bf1f49b4-6179-4503-9d38-7e778f1b5425 tempest-SnapshotMetadataTestJSON-1447486369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa.0254d2ca-37c9-44f3-a1aa-505061aab5a8" returned: 0 in 0.315s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bf1f49b4-6179-4503-9d38-7e778f1b5425 tempest-SnapshotMetadataTestJSON-1447486369 None] Lock "cinder-quobyte-0254d2ca-37c9-44f3-a1aa-505061aab5a8" released by "_delete_snapshot" :: held 2.240s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bf1f49b4-6179-4503-9d38-7e778f1b5425 tempest-SnapshotMetadataTestJSON-1447486369 None] Lock "cinder-quobyte-8703bcda-7d33-4835-87b3-31e15076cafa" released by "delete_snapshot" :: held 2.275s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:48 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-bf1f49b4-6179-4503-9d38-7e778f1b5425 tempest-SnapshotMetadataTestJSON-1447486369 None] Created reservations ['8a871070-dddd-45a0-97c1-197078b61912', '0da8349a-132c-4436-b91d-db18705d8e3a', '9b6ed598-f334-4450-8849-162b1696ac67', '6354e22e-f914-4240-b907-8331c66a952f'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:48 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-bf1f49b4-6179-4503-9d38-7e778f1b5425 tempest-SnapshotMetadataTestJSON-1447486369 None] Delete snapshot completed successfully. Nov 03 07:33:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bf1f49b4-6179-4503-9d38-7e778f1b5425 tempest-SnapshotMetadataTestJSON-1447486369 None] Lock "cinder-0254d2ca-37c9-44f3-a1aa-505061aab5a8-delete_snapshot" released by "delete_snapshot" :: held 2.495s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:33:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:49 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:33:49 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:49 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.415s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:33:49 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-65f5418a-c4e9-40d5-8320-e8b0ac621896 tempest-SnapshotMetadataTestJSON-1447486369 None] Acquiring lock "cinder-8703bcda-7d33-4835-87b3-31e15076cafa-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:33:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 28 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:33:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:33:49 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-65f5418a-c4e9-40d5-8320-e8b0ac621896 tempest-SnapshotMetadataTestJSON-1447486369 None] Lock "cinder-8703bcda-7d33-4835-87b3-31e15076cafa-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:49 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-65f5418a-c4e9-40d5-8320-e8b0ac621896 tempest-SnapshotMetadataTestJSON-1447486369 None] Acquiring lock "cinder-quobyte-8703bcda-7d33-4835-87b3-31e15076cafa" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:49 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-65f5418a-c4e9-40d5-8320-e8b0ac621896 tempest-SnapshotMetadataTestJSON-1447486369 None] Lock "cinder-quobyte-8703bcda-7d33-4835-87b3-31e15076cafa" acquired by "delete_volume" :: waited 0.029s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:49 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0873c30-f4c9-4190-8f98-5c188f865402]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-65f5418a-c4e9-40d5-8320-e8b0ac621896 tempest-SnapshotMetadataTestJSON-1447486369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:50 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa Nov 03 07:33:50 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:50 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-65f5418a-c4e9-40d5-8320-e8b0ac621896 tempest-SnapshotMetadataTestJSON-1447486369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa" returned: 0 in 0.709s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-65f5418a-c4e9-40d5-8320-e8b0ac621896 tempest-SnapshotMetadataTestJSON-1447486369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "cinder-quobyte-5d59bf29-c20d-4538-a128-1e94e2170b60-ceda6af9-f77c-4eef-9b89-efd7ac37408c" by "_create_volume_from_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-5d59bf29-c20d-4538-a128-1e94e2170b60-ceda6af9-f77c-4eef-9b89-efd7ac37408c" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Creating volume ceda6af9-f77c-4eef-9b89-efd7ac37408c from snapshot 5d59bf29-c20d-4538-a128-1e94e2170b60 {{(pid=87016) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:33:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:50 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa Nov 03 07:33:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:50 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:33:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "cinder-quobyte-ceda6af9-f77c-4eef-9b89-efd7ac37408c" by "_copy_volume_from_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-ceda6af9-f77c-4eef-9b89-efd7ac37408c" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] snapshot: 5d59bf29-c20d-4538-a128-1e94e2170b60, volume: ceda6af9-f77c-4eef-9b89-efd7ac37408c, {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:33:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:50 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb8d840-ed82-4bf8-acb9-4d942d1bbc93]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.5d59bf29-c20d-4538-a128-1e94e2170b60 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:51 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.5d59bf29-c20d-4538-a128-1e94e2170b60 Nov 03 07:33:51 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:51 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-65f5418a-c4e9-40d5-8320-e8b0ac621896 tempest-SnapshotMetadataTestJSON-1447486369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8703bcda-7d33-4835-87b3-31e15076cafa" returned: 0 in 0.670s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-65f5418a-c4e9-40d5-8320-e8b0ac621896 tempest-SnapshotMetadataTestJSON-1447486369 None] Lock "cinder-quobyte-8703bcda-7d33-4835-87b3-31e15076cafa" released by "delete_volume" :: held 1.520s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:51 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-65f5418a-c4e9-40d5-8320-e8b0ac621896 tempest-SnapshotMetadataTestJSON-1447486369 None] Created reservations ['0de04af3-0a59-47c4-947d-337dd544053f', 'eaeaf45c-f3f2-448e-8083-ba8d9c0dd663', 'bd308a8c-bab1-41ee-bbd6-8b6ac2710ae9', '0ab95ed8-8395-44dd-8fc3-5556b9b49b46'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:51 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.5d59bf29-c20d-4538-a128-1e94e2170b60" returned: 0 in 0.723s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:33:51 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19c32c3-8c8a-4257-b709-e12d8b959d32]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-65f5418a-c4e9-40d5-8320-e8b0ac621896 tempest-SnapshotMetadataTestJSON-1447486369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-65f5418a-c4e9-40d5-8320-e8b0ac621896 tempest-SnapshotMetadataTestJSON-1447486369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-65f5418a-c4e9-40d5-8320-e8b0ac621896 tempest-SnapshotMetadataTestJSON-1447486369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-65f5418a-c4e9-40d5-8320-e8b0ac621896 tempest-SnapshotMetadataTestJSON-1447486369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-65f5418a-c4e9-40d5-8320-e8b0ac621896 tempest-SnapshotMetadataTestJSON-1447486369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-65f5418a-c4e9-40d5-8320-e8b0ac621896 tempest-SnapshotMetadataTestJSON-1447486369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:51 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:33:51 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:51 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d Nov 03 07:33:51 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:52 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-65f5418a-c4e9-40d5-8320-e8b0ac621896 tempest-SnapshotMetadataTestJSON-1447486369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.427s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:52 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-65f5418a-c4e9-40d5-8320-e8b0ac621896 tempest-SnapshotMetadataTestJSON-1447486369 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:33:52 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-65f5418a-c4e9-40d5-8320-e8b0ac621896 tempest-SnapshotMetadataTestJSON-1447486369 None] Deleted volume successfully. Nov 03 07:33:52 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d" returned: 0 in 0.607s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:33:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Creating direct copy from snapshot {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:33:52 devstack cinder-volume[87016]: DEBUG cinder.utils [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Path /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ceda6af9-f77c-4eef-9b89-efd7ac37408c not found in is_blk_device check {{(pid=87016) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 07:33:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ceda6af9-f77c-4eef-9b89-efd7ac37408c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-65f5418a-c4e9-40d5-8320-e8b0ac621896 tempest-SnapshotMetadataTestJSON-1447486369 None] Lock "cinder-8703bcda-7d33-4835-87b3-31e15076cafa-delete_volume" released by "delete_volume" :: held 2.607s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:52 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ceda6af9-f77c-4eef-9b89-efd7ac37408c Nov 03 07:33:52 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-7d906870-6038-48dd-8c37-a2704ff8f26b req-7843bf6f-53bb-4949-adae-14d269c10e7f tempest-TestInstancesWithCinderVolumes-719158012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:02 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ceda6af9-f77c-4eef-9b89-efd7ac37408c" returned: 0 in 10.199s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:02 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Image conversion details: src /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d, size 1024.00 MB, duration 10.20 sec, destination /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ceda6af9-f77c-4eef-9b89-efd7ac37408c {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:34:02 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Converted 1024.00 MB image at 100.39 MB/s Nov 03 07:34:02 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ceda6af9-f77c-4eef-9b89-efd7ac37408c is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:34:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ceda6af9-f77c-4eef-9b89-efd7ac37408c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:02 devstack sudo[98273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ceda6af9-f77c-4eef-9b89-efd7ac37408c Nov 03 07:34:02 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:02 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ceda6af9-f77c-4eef-9b89-efd7ac37408c" returned: 0 in 0.367s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:02 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-ceda6af9-f77c-4eef-9b89-efd7ac37408c" released by "_copy_volume_from_snapshot" :: held 12.073s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:02 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-5d59bf29-c20d-4538-a128-1e94e2170b60-ceda6af9-f77c-4eef-9b89-efd7ac37408c" released by "_create_volume_from_snapshot" :: held 12.189s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.234s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-7d906870-6038-48dd-8c37-a2704ff8f26b req-7843bf6f-53bb-4949-adae-14d269c10e7f tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.050s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-7d906870-6038-48dd-8c37-a2704ff8f26b req-7843bf6f-53bb-4949-adae-14d269c10e7f tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:02 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-7d906870-6038-48dd-8c37-a2704ff8f26b req-7843bf6f-53bb-4949-adae-14d269c10e7f tempest-TestInstancesWithCinderVolumes-719158012 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14', 'name': 'volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '003e5679-56d6-4df5-88b3-81d91fc0447d', 'enforce_multipath': True} {{(pid=87016) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:34:02 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a19b72ec-6f26-4b7c-ad3a-fb45cebc4c28 tempest-GroupSnapshotsTest-1286634275 None] Create group from source-snapshot-4a8758d0-2150-4822-a5c3-c318f73b9ea6 completed successfully. Nov 03 07:34:03 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-7d906870-6038-48dd-8c37-a2704ff8f26b req-7843bf6f-53bb-4949-adae-14d269c10e7f tempest-TestInstancesWithCinderVolumes-719158012 None] attachment_update completed successfully. Nov 03 07:34:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e1eafe96-02a2-4fce-9555-288c913fcb6e tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "cinder-quobyte-ceda6af9-f77c-4eef-9b89-efd7ac37408c" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e1eafe96-02a2-4fce-9555-288c913fcb6e tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-ceda6af9-f77c-4eef-9b89-efd7ac37408c" acquired by "delete_volume" :: waited 0.042s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:03 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fcf1a3-415a-4c4d-95ec-994710386f73]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e1eafe96-02a2-4fce-9555-288c913fcb6e tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ceda6af9-f77c-4eef-9b89-efd7ac37408c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:03 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ceda6af9-f77c-4eef-9b89-efd7ac37408c Nov 03 07:34:03 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:04 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e1eafe96-02a2-4fce-9555-288c913fcb6e tempest-GroupSnapshotsTest-1286634275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ceda6af9-f77c-4eef-9b89-efd7ac37408c" returned: 0 in 0.810s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e1eafe96-02a2-4fce-9555-288c913fcb6e tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ceda6af9-f77c-4eef-9b89-efd7ac37408c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:04 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ceda6af9-f77c-4eef-9b89-efd7ac37408c Nov 03 07:34:04 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:05 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e1eafe96-02a2-4fce-9555-288c913fcb6e tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ceda6af9-f77c-4eef-9b89-efd7ac37408c" returned: 0 in 0.438s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e1eafe96-02a2-4fce-9555-288c913fcb6e tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-ceda6af9-f77c-4eef-9b89-efd7ac37408c" released by "delete_volume" :: held 1.366s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:05 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-e1eafe96-02a2-4fce-9555-288c913fcb6e tempest-GroupSnapshotsTest-1286634275 None] Created reservations ['942ca60c-fd12-4156-9199-364ba313a9c4'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:05 devstack cinder-volume[87016]: WARNING cinder.quota [None req-e1eafe96-02a2-4fce-9555-288c913fcb6e tempest-GroupSnapshotsTest-1286634275 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-484137416 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-484137416, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:34:05 devstack cinder-volume[87016]: WARNING cinder.quota [None req-e1eafe96-02a2-4fce-9555-288c913fcb6e tempest-GroupSnapshotsTest-1286634275 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-484137416 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-484137416, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:34:05 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-e1eafe96-02a2-4fce-9555-288c913fcb6e tempest-GroupSnapshotsTest-1286634275 None] Created reservations ['409dbebb-1583-4129-9975-522d8b8c8f48', '7bb06bde-a71d-47ad-aced-6afd084e69fa', 'cd4b98e5-bd20-4123-8e4d-f04fbf0c8623', '090c3ddd-d379-4305-9c3d-e75adbd14184'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e1eafe96-02a2-4fce-9555-288c913fcb6e tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e1eafe96-02a2-4fce-9555-288c913fcb6e tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e1eafe96-02a2-4fce-9555-288c913fcb6e tempest-GroupSnapshotsTest-1286634275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e1eafe96-02a2-4fce-9555-288c913fcb6e tempest-GroupSnapshotsTest-1286634275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e1eafe96-02a2-4fce-9555-288c913fcb6e tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e1eafe96-02a2-4fce-9555-288c913fcb6e tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:05 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:34:05 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:06 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e1eafe96-02a2-4fce-9555-288c913fcb6e tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.437s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:06 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-e1eafe96-02a2-4fce-9555-288c913fcb6e tempest-GroupSnapshotsTest-1286634275 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:06 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-e1eafe96-02a2-4fce-9555-288c913fcb6e tempest-GroupSnapshotsTest-1286634275 None] Delete group completed successfully. Nov 03 07:34:06 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-22089501-97b1-481a-9fb6-38387f789b1a tempest-GroupSnapshotsTest-1286634275 None] group_snapshot 4a8758d0-2150-4822-a5c3-c318f73b9ea6: deleting Nov 03 07:34:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-22089501-97b1-481a-9fb6-38387f789b1a tempest-GroupSnapshotsTest-1286634275 None] group_snapshot 4a8758d0-2150-4822-a5c3-c318f73b9ea6: deleting {{(pid=87016) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 07:34:06 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-22089501-97b1-481a-9fb6-38387f789b1a tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "cinder-quobyte-4b75ee3d-0200-4482-9d72-e88da4f8df8d" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:06 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-22089501-97b1-481a-9fb6-38387f789b1a tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-4b75ee3d-0200-4482-9d72-e88da4f8df8d" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:06 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-22089501-97b1-481a-9fb6-38387f789b1a tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "cinder-quobyte-5d59bf29-c20d-4538-a128-1e94e2170b60" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:06 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-22089501-97b1-481a-9fb6-38387f789b1a tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-5d59bf29-c20d-4538-a128-1e94e2170b60" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:06 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-22089501-97b1-481a-9fb6-38387f789b1a tempest-GroupSnapshotsTest-1286634275 None] Deleting offline snapshot 5d59bf29-c20d-4538-a128-1e94e2170b60 of volume 4b75ee3d-0200-4482-9d72-e88da4f8df8d {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:34:06 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-22089501-97b1-481a-9fb6-38387f789b1a tempest-GroupSnapshotsTest-1286634275 None] snapshot_file for this snap is: volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.5d59bf29-c20d-4538-a128-1e94e2170b60 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:34:06 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[d748f5e1-ced9-4af5-b65b-3d5eb6231aa5]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-22089501-97b1-481a-9fb6-38387f789b1a tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.5d59bf29-c20d-4538-a128-1e94e2170b60 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:07 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.5d59bf29-c20d-4538-a128-1e94e2170b60 Nov 03 07:34:07 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:07 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-22089501-97b1-481a-9fb6-38387f789b1a tempest-GroupSnapshotsTest-1286634275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.5d59bf29-c20d-4538-a128-1e94e2170b60" returned: 0 in 0.726s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:07 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-22089501-97b1-481a-9fb6-38387f789b1a tempest-GroupSnapshotsTest-1286634275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:34:07 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f77861-a005-4cbd-9d76-26d1a80a79a5]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-22089501-97b1-481a-9fb6-38387f789b1a tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:07 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d Nov 03 07:34:07 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:08 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-22089501-97b1-481a-9fb6-38387f789b1a tempest-GroupSnapshotsTest-1286634275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d" returned: 0 in 1.112s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-22089501-97b1-481a-9fb6-38387f789b1a tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.5d59bf29-c20d-4538-a128-1e94e2170b60 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:08 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.5d59bf29-c20d-4538-a128-1e94e2170b60 Nov 03 07:34:08 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:09 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-22089501-97b1-481a-9fb6-38387f789b1a tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.5d59bf29-c20d-4538-a128-1e94e2170b60" returned: 0 in 0.886s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-22089501-97b1-481a-9fb6-38387f789b1a tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.5d59bf29-c20d-4538-a128-1e94e2170b60 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:09 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.5d59bf29-c20d-4538-a128-1e94e2170b60 Nov 03 07:34:09 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:10 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-22089501-97b1-481a-9fb6-38387f789b1a tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d.5d59bf29-c20d-4538-a128-1e94e2170b60" returned: 0 in 0.583s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:10 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-22089501-97b1-481a-9fb6-38387f789b1a tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-5d59bf29-c20d-4538-a128-1e94e2170b60" released by "_delete_snapshot" :: held 3.514s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:10 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-22089501-97b1-481a-9fb6-38387f789b1a tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-4b75ee3d-0200-4482-9d72-e88da4f8df8d" released by "delete_snapshot" :: held 3.576s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:10 devstack cinder-volume[87016]: WARNING cinder.quota [None req-22089501-97b1-481a-9fb6-38387f789b1a tempest-GroupSnapshotsTest-1286634275 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-484137416 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-484137416, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:34:10 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-22089501-97b1-481a-9fb6-38387f789b1a tempest-GroupSnapshotsTest-1286634275 None] Created reservations ['9022db2f-b742-4930-9f26-951fb89c4efb', '5eaee266-fcb6-402e-ad39-49c94136735a', '39b25960-2f71-4f58-8986-539a1b38ddbc', '13176665-6d2b-4a40-98bb-dd8e9e242ebd'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:10 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-22089501-97b1-481a-9fb6-38387f789b1a tempest-GroupSnapshotsTest-1286634275 None] group_snapshot 4a8758d0-2150-4822-a5c3-c318f73b9ea6: deleted successfully Nov 03 07:34:11 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4622dd5a-26e3-48df-867d-16146764ceb9 tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "cinder-quobyte-4b75ee3d-0200-4482-9d72-e88da4f8df8d" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:11 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4622dd5a-26e3-48df-867d-16146764ceb9 tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-4b75ee3d-0200-4482-9d72-e88da4f8df8d" acquired by "delete_volume" :: waited 0.031s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[8048d822-3096-4aaa-8f97-68ba3aaf3278]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4622dd5a-26e3-48df-867d-16146764ceb9 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:12 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d Nov 03 07:34:12 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Flow 'volume_create_manager' (3f041848-58b5-49ae-87d1-e6356a873405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a89e928b-db98-4fda-bf72-03ca8712ac5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a89e928b-db98-4fda-bf72-03ca8712ac5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1792861734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65685c58-62e9-4092-a5b0-23b8ad626add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d714017f2fd4e27819002ac87ac29ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:12Z,use_quota=True,user_id='3412dfb8889e4387a2c2591e0a1378e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0887dfd-47ad-414e-82de-ff78f8cd1abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0887dfd-47ad-414e-82de-ff78f8cd1abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b257dba8-f1b7-42ee-9cb4-76e266fcf40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b257dba8-f1b7-42ee-9cb4-76e266fcf40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65685c58-62e9-4092-a5b0-23b8ad626add', 'volume_name': 'volume-65685c58-62e9-4092-a5b0-23b8ad626add', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac05144f-3518-4000-8330-7582cbcee286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac05144f-3518-4000-8330-7582cbcee286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be08ef8-06ee-4f96-b43c-b3031f032936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:12 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Volume 65685c58-62e9-4092-a5b0-23b8ad626add: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65685c58-62e9-4092-a5b0-23b8ad626add', 'volume_size': 1} Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1792861734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65685c58-62e9-4092-a5b0-23b8ad626add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d714017f2fd4e27819002ac87ac29ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:12Z,use_quota=True,user_id='3412dfb8889e4387a2c2591e0a1378e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Creating volume 65685c58-62e9-4092-a5b0-23b8ad626add {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:34:12 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:34:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65685c58-62e9-4092-a5b0-23b8ad626add 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:12 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65685c58-62e9-4092-a5b0-23b8ad626add 1073741824 Nov 03 07:34:12 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:13 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4622dd5a-26e3-48df-867d-16146764ceb9 tempest-GroupSnapshotsTest-1286634275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d" returned: 0 in 0.986s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4622dd5a-26e3-48df-867d-16146764ceb9 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:13 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d Nov 03 07:34:13 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:13 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4622dd5a-26e3-48df-867d-16146764ceb9 tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4b75ee3d-0200-4482-9d72-e88da4f8df8d" returned: 0 in 0.580s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4622dd5a-26e3-48df-867d-16146764ceb9 tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-4b75ee3d-0200-4482-9d72-e88da4f8df8d" released by "delete_volume" :: held 1.764s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:13 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65685c58-62e9-4092-a5b0-23b8ad626add 1073741824" returned: 0 in 0.904s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65685c58-62e9-4092-a5b0-23b8ad626add {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:13 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65685c58-62e9-4092-a5b0-23b8ad626add Nov 03 07:34:13 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:13 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-4622dd5a-26e3-48df-867d-16146764ceb9 tempest-GroupSnapshotsTest-1286634275 None] Created reservations ['ab596e1c-4762-4a61-a00b-b71795213d1f'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:13 devstack cinder-volume[87016]: WARNING cinder.db.api [None req-4622dd5a-26e3-48df-867d-16146764ceb9 tempest-GroupSnapshotsTest-1286634275 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-484137416'] Nov 03 07:34:13 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-4622dd5a-26e3-48df-867d-16146764ceb9 tempest-GroupSnapshotsTest-1286634275 None] Created reservations ['77d4b00d-e849-4405-9428-a8d22268a0a8', 'a124fc71-1e6a-4277-9c31-af5dee1d8200', 'fc5e46d9-8a9c-4123-b216-0468ef4a9648', '7c3c96ce-1518-4a5b-801a-f02832445474'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4622dd5a-26e3-48df-867d-16146764ceb9 tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4622dd5a-26e3-48df-867d-16146764ceb9 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4622dd5a-26e3-48df-867d-16146764ceb9 tempest-GroupSnapshotsTest-1286634275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4622dd5a-26e3-48df-867d-16146764ceb9 tempest-GroupSnapshotsTest-1286634275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4622dd5a-26e3-48df-867d-16146764ceb9 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4622dd5a-26e3-48df-867d-16146764ceb9 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:14 devstack sudo[98803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:34:14 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:14 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65685c58-62e9-4092-a5b0-23b8ad626add" returned: 0 in 0.782s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:34:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be08ef8-06ee-4f96-b43c-b3031f032936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65685c58-62e9-4092-a5b0-23b8ad626add', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba439a5-cf8c-435d-9ce6-1775ee0f57f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:14 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Volume volume-65685c58-62e9-4092-a5b0-23b8ad626add (65685c58-62e9-4092-a5b0-23b8ad626add): created successfully Nov 03 07:34:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba439a5-cf8c-435d-9ce6-1775ee0f57f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Flow 'volume_create_manager' (3f041848-58b5-49ae-87d1-e6356a873405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:14 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-601fb098-575c-427b-a626-1484c869821d tempest-AbsoluteLimitsTests-1594059468 None] Created volume successfully. Nov 03 07:34:15 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4622dd5a-26e3-48df-867d-16146764ceb9 tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.711s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:15 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-4622dd5a-26e3-48df-867d-16146764ceb9 tempest-GroupSnapshotsTest-1286634275 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:15 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-4622dd5a-26e3-48df-867d-16146764ceb9 tempest-GroupSnapshotsTest-1286634275 None] Delete group completed successfully. Nov 03 07:34:15 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-d5297310-8c8f-46d6-ad27-50a4db945118 tempest-GroupSnapshotsTest-1286634275 None] Group tempest-GroupSnapshotsTest-Group-1929932524: creating Nov 03 07:34:15 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-d5297310-8c8f-46d6-ad27-50a4db945118 tempest-GroupSnapshotsTest-1286634275 None] Group tempest-GroupSnapshotsTest-Group-1929932524: created successfully Nov 03 07:34:15 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-d5297310-8c8f-46d6-ad27-50a4db945118 tempest-GroupSnapshotsTest-1286634275 None] Create group completed successfully. Nov 03 07:34:16 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-836cce98-9125-4417-b66a-533b7080d5e5 tempest-AbsoluteLimitsTests-1594059468 None] Acquiring lock "cinder-65685c58-62e9-4092-a5b0-23b8ad626add-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:16 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-836cce98-9125-4417-b66a-533b7080d5e5 tempest-AbsoluteLimitsTests-1594059468 None] Lock "cinder-65685c58-62e9-4092-a5b0-23b8ad626add-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:16 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-836cce98-9125-4417-b66a-533b7080d5e5 tempest-AbsoluteLimitsTests-1594059468 None] Acquiring lock "cinder-quobyte-65685c58-62e9-4092-a5b0-23b8ad626add" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:16 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-836cce98-9125-4417-b66a-533b7080d5e5 tempest-AbsoluteLimitsTests-1594059468 None] Lock "cinder-quobyte-65685c58-62e9-4092-a5b0-23b8ad626add" acquired by "delete_volume" :: waited 0.033s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:16 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[408fcaac-0c87-4c2a-b288-b99e409d08d3]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-836cce98-9125-4417-b66a-533b7080d5e5 tempest-AbsoluteLimitsTests-1594059468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65685c58-62e9-4092-a5b0-23b8ad626add {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:17 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65685c58-62e9-4092-a5b0-23b8ad626add Nov 03 07:34:17 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:17 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-836cce98-9125-4417-b66a-533b7080d5e5 tempest-AbsoluteLimitsTests-1594059468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65685c58-62e9-4092-a5b0-23b8ad626add" returned: 0 in 0.934s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-836cce98-9125-4417-b66a-533b7080d5e5 tempest-AbsoluteLimitsTests-1594059468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65685c58-62e9-4092-a5b0-23b8ad626add {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:17 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65685c58-62e9-4092-a5b0-23b8ad626add Nov 03 07:34:17 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:17 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Flow 'volume_create_manager' (8780dd8f-a595-45cc-9943-64e90896d404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f10d13-86bc-4aab-bff1-9247be09da4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f10d13-86bc-4aab-bff1-9247be09da4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-24380373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b03339-b4b9-44f0-9556-dda114c6c8a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d28b732b8a39472293bb23f6dd663461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:18Z,use_quota=True,user_id='8f79be5dbe3e4664bd276f643d4fa2e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4ea6e3-9fee-4ebf-899f-05941d52dee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4ea6e3-9fee-4ebf-899f-05941d52dee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5554db2-ee4e-4d53-9de0-c4b4071b954f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5554db2-ee4e-4d53-9de0-c4b4071b954f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2b03339-b4b9-44f0-9556-dda114c6c8a5', 'volume_name': 'volume-f2b03339-b4b9-44f0-9556-dda114c6c8a5', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d1090aa-4a10-4f59-8a6e-7889124a550a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d1090aa-4a10-4f59-8a6e-7889124a550a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e230c6b2-6dc8-4838-a769-4d01912f55b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:18 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Volume f2b03339-b4b9-44f0-9556-dda114c6c8a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2b03339-b4b9-44f0-9556-dda114c6c8a5', 'volume_size': 1} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-24380373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b03339-b4b9-44f0-9556-dda114c6c8a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d28b732b8a39472293bb23f6dd663461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:18Z,use_quota=True,user_id='8f79be5dbe3e4664bd276f643d4fa2e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Creating volume f2b03339-b4b9-44f0-9556-dda114c6c8a5 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:34:18 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f2b03339-b4b9-44f0-9556-dda114c6c8a5 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:18 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f2b03339-b4b9-44f0-9556-dda114c6c8a5 1073741824 Nov 03 07:34:18 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:18 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-836cce98-9125-4417-b66a-533b7080d5e5 tempest-AbsoluteLimitsTests-1594059468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65685c58-62e9-4092-a5b0-23b8ad626add" returned: 0 in 0.716s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-836cce98-9125-4417-b66a-533b7080d5e5 tempest-AbsoluteLimitsTests-1594059468 None] Lock "cinder-quobyte-65685c58-62e9-4092-a5b0-23b8ad626add" released by "delete_volume" :: held 1.729s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Flow 'volume_create_manager' (db06be19-f0c2-463d-97f6-f8cd8b6b3e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16383c03-1606-48ce-aed4-d373f04a4f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16383c03-1606-48ce-aed4-d373f04a4f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-46242366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=381e3036-9971-4bbe-acc9-2e4f49bbe330,host='devstack@QuobyteHD#QuobyteHD',id=33a10506-1a2e-4e90-87b5-155dd2649bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc32a96045304dcb8f916b642238b4a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:18Z,use_quota=True,user_id='72707c655e6743ac9d78a00c85b7e5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76eac061-e7b0-49f6-bc72-7f8b640d3169),volume_type_id=76eac061-e7b0-49f6-bc72-7f8b640d3169)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f40361-80b9-44da-87aa-7880be9a03e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f40361-80b9-44da-87aa-7880be9a03e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60a15b1-dc0a-4dc6-882e-a6532d11ee3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60a15b1-dc0a-4dc6-882e-a6532d11ee3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33a10506-1a2e-4e90-87b5-155dd2649bb7', 'volume_name': 'volume-33a10506-1a2e-4e90-87b5-155dd2649bb7', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65cf6fb7-6ede-4446-91d0-0c27e9f9cb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65cf6fb7-6ede-4446-91d0-0c27e9f9cb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537f5707-8738-4c74-b3ad-f299aedf1895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:18 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Volume 33a10506-1a2e-4e90-87b5-155dd2649bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33a10506-1a2e-4e90-87b5-155dd2649bb7', 'volume_size': 1} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-836cce98-9125-4417-b66a-533b7080d5e5 tempest-AbsoluteLimitsTests-1594059468 None] Created reservations ['5f804d39-7501-440c-8a92-9eb0c8c5cd7f', '768db4cc-ade3-4da6-97e6-f4577c4479f3', '5adb8226-9176-4cd2-a5d2-93d45cd89a2a', '1ff36d60-e81f-405b-ad4f-958cc672fb1c'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-836cce98-9125-4417-b66a-533b7080d5e5 tempest-AbsoluteLimitsTests-1594059468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-836cce98-9125-4417-b66a-533b7080d5e5 tempest-AbsoluteLimitsTests-1594059468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-836cce98-9125-4417-b66a-533b7080d5e5 tempest-AbsoluteLimitsTests-1594059468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-836cce98-9125-4417-b66a-533b7080d5e5 tempest-AbsoluteLimitsTests-1594059468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-836cce98-9125-4417-b66a-533b7080d5e5 tempest-AbsoluteLimitsTests-1594059468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-836cce98-9125-4417-b66a-533b7080d5e5 tempest-AbsoluteLimitsTests-1594059468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:19 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:34:19 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:19 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f2b03339-b4b9-44f0-9556-dda114c6c8a5 1073741824" returned: 0 in 0.971s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f2b03339-b4b9-44f0-9556-dda114c6c8a5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:19 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f2b03339-b4b9-44f0-9556-dda114c6c8a5 Nov 03 07:34:19 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:19 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-836cce98-9125-4417-b66a-533b7080d5e5 tempest-AbsoluteLimitsTests-1594059468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.634s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:19 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-836cce98-9125-4417-b66a-533b7080d5e5 tempest-AbsoluteLimitsTests-1594059468 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:19 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-836cce98-9125-4417-b66a-533b7080d5e5 tempest-AbsoluteLimitsTests-1594059468 None] Deleted volume successfully. Nov 03 07:34:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-836cce98-9125-4417-b66a-533b7080d5e5 tempest-AbsoluteLimitsTests-1594059468 None] Lock "cinder-65685c58-62e9-4092-a5b0-23b8ad626add-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:19 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f2b03339-b4b9-44f0-9556-dda114c6c8a5" returned: 0 in 0.602s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:34:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.219s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=381e3036-9971-4bbe-acc9-2e4f49bbe330,created_at=2026-11-03T06:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-46242366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=381e3036-9971-4bbe-acc9-2e4f49bbe330,host='devstack@QuobyteHD#QuobyteHD',id=33a10506-1a2e-4e90-87b5-155dd2649bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc32a96045304dcb8f916b642238b4a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:18Z,use_quota=True,user_id='72707c655e6743ac9d78a00c85b7e5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76eac061-e7b0-49f6-bc72-7f8b640d3169),volume_type_id=76eac061-e7b0-49f6-bc72-7f8b640d3169)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:34:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Creating volume 33a10506-1a2e-4e90-87b5-155dd2649bb7 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:34:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:34:19 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:34:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:19 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7 1073741824 Nov 03 07:34:19 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e230c6b2-6dc8-4838-a769-4d01912f55b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2b03339-b4b9-44f0-9556-dda114c6c8a5', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:20 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f37047d-003c-44a5-b7c6-fd3bc404ac76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:20 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Volume volume-f2b03339-b4b9-44f0-9556-dda114c6c8a5 (f2b03339-b4b9-44f0-9556-dda114c6c8a5): created successfully Nov 03 07:34:20 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f37047d-003c-44a5-b7c6-fd3bc404ac76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:20 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Flow 'volume_create_manager' (8780dd8f-a595-45cc-9943-64e90896d404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:20 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-f3e7fcc2-df97-4c97-a72c-3b29a1253cc9 tempest-VolumesListAdminTestJSON-1191152965 None] Created volume successfully. Nov 03 07:34:20 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7 1073741824" returned: 0 in 0.653s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:20 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7 Nov 03 07:34:20 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:21 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7" returned: 0 in 0.463s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537f5707-8738-4c74-b3ad-f299aedf1895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33a10506-1a2e-4e90-87b5-155dd2649bb7', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e6f5f0-bb7d-414f-880d-62df74682614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:21 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Volume volume-33a10506-1a2e-4e90-87b5-155dd2649bb7 (33a10506-1a2e-4e90-87b5-155dd2649bb7): created successfully Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e6f5f0-bb7d-414f-880d-62df74682614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Flow 'volume_create_manager' (db06be19-f0c2-463d-97f6-f8cd8b6b3e91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:21 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-172f8018-efd4-4913-b2f1-c20f725cb742 tempest-GroupSnapshotsTest-1286634275 None] Created volume successfully. Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Flow 'volume_create_manager' (0512b0d3-e78c-4362-bddd-1b39fb2c1732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f7f7bf-1d92-48d8-a57a-b63834414b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f7f7bf-1d92-48d8-a57a-b63834414b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1673803704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21612e07-ae47-4782-905d-23af45942d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d28b732b8a39472293bb23f6dd663461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:22Z,use_quota=True,user_id='8f79be5dbe3e4664bd276f643d4fa2e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c044cb4-6b71-4c41-b101-922495071cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c044cb4-6b71-4c41-b101-922495071cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd370db-2f58-4f69-abba-03fcd23b41b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd370db-2f58-4f69-abba-03fcd23b41b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21612e07-ae47-4782-905d-23af45942d66', 'volume_name': 'volume-21612e07-ae47-4782-905d-23af45942d66', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b25e29f-f154-4661-baa1-0267596140ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b25e29f-f154-4661-baa1-0267596140ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11411971-f563-49a3-9896-897360c4135d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:21 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Volume 21612e07-ae47-4782-905d-23af45942d66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21612e07-ae47-4782-905d-23af45942d66', 'volume_size': 1} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1673803704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21612e07-ae47-4782-905d-23af45942d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d28b732b8a39472293bb23f6dd663461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:22Z,use_quota=True,user_id='8f79be5dbe3e4664bd276f643d4fa2e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Creating volume 21612e07-ae47-4782-905d-23af45942d66 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:34:21 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:34:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-21612e07-ae47-4782-905d-23af45942d66 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:22 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-21612e07-ae47-4782-905d-23af45942d66 1073741824 Nov 03 07:34:22 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:22 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-21612e07-ae47-4782-905d-23af45942d66 1073741824" returned: 0 in 0.900s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-21612e07-ae47-4782-905d-23af45942d66 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:23 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-21612e07-ae47-4782-905d-23af45942d66 Nov 03 07:34:23 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Flow 'volume_create_manager' (fe62dafd-58e4-4480-bd23-4b506e080531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da02a76-19a7-4a3d-9583-7e6a84a861f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:23 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-21612e07-ae47-4782-905d-23af45942d66" returned: 0 in 0.724s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da02a76-19a7-4a3d-9583-7e6a84a861f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-686362648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=381e3036-9971-4bbe-acc9-2e4f49bbe330,host='devstack@QuobyteHD#QuobyteHD',id=8dc76109-7b39-4dbf-8391-8b361a83743d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc32a96045304dcb8f916b642238b4a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:23Z,use_quota=True,user_id='72707c655e6743ac9d78a00c85b7e5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76eac061-e7b0-49f6-bc72-7f8b640d3169),volume_type_id=76eac061-e7b0-49f6-bc72-7f8b640d3169)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a114e9-3612-40eb-b317-95bed77b7ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a114e9-3612-40eb-b317-95bed77b7ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846286f0-42d7-4bc9-b42b-d2d72668151d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846286f0-42d7-4bc9-b42b-d2d72668151d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dc76109-7b39-4dbf-8391-8b361a83743d', 'volume_name': 'volume-8dc76109-7b39-4dbf-8391-8b361a83743d', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bc5a30-7fe2-43af-8c80-440419e6f91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bc5a30-7fe2-43af-8c80-440419e6f91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe71e184-49b1-445b-bf94-723f20ef52f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:23 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Volume 8dc76109-7b39-4dbf-8391-8b361a83743d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dc76109-7b39-4dbf-8391-8b361a83743d', 'volume_size': 1} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=381e3036-9971-4bbe-acc9-2e4f49bbe330,created_at=2026-11-03T06:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-686362648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=381e3036-9971-4bbe-acc9-2e4f49bbe330,host='devstack@QuobyteHD#QuobyteHD',id=8dc76109-7b39-4dbf-8391-8b361a83743d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc32a96045304dcb8f916b642238b4a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:23Z,use_quota=True,user_id='72707c655e6743ac9d78a00c85b7e5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76eac061-e7b0-49f6-bc72-7f8b640d3169),volume_type_id=76eac061-e7b0-49f6-bc72-7f8b640d3169)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Creating volume 8dc76109-7b39-4dbf-8391-8b361a83743d {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:34:23 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11411971-f563-49a3-9896-897360c4135d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21612e07-ae47-4782-905d-23af45942d66', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:23 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d 1073741824 Nov 03 07:34:23 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4971c125-b750-4565-b009-9dd91188abdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:23 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Volume volume-21612e07-ae47-4782-905d-23af45942d66 (21612e07-ae47-4782-905d-23af45942d66): created successfully Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4971c125-b750-4565-b009-9dd91188abdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Flow 'volume_create_manager' (0512b0d3-e78c-4362-bddd-1b39fb2c1732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:23 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-75f5c76c-5433-456c-8ce6-ebefb009bc14 tempest-VolumesListAdminTestJSON-1191152965 None] Created volume successfully. Nov 03 07:34:24 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d 1073741824" returned: 0 in 0.615s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:24 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d Nov 03 07:34:24 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:24 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d" returned: 0 in 0.269s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:24 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:34:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe71e184-49b1-445b-bf94-723f20ef52f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc76109-7b39-4dbf-8391-8b361a83743d', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954cdfeb-3959-4ff2-b9a8-48bb5091ef3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:24 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Volume volume-8dc76109-7b39-4dbf-8391-8b361a83743d (8dc76109-7b39-4dbf-8391-8b361a83743d): created successfully Nov 03 07:34:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954cdfeb-3959-4ff2-b9a8-48bb5091ef3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Flow 'volume_create_manager' (fe62dafd-58e4-4480-bd23-4b506e080531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:24 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-f0008877-43ee-418d-b2c3-45b26ba4b9bd tempest-GroupSnapshotsTest-1286634275 None] Created volume successfully. Nov 03 07:34:25 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Flow 'volume_create_manager' (73220c19-4d5d-41a5-b492-e3b424b121e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c1e8d4c-ca4e-4c4d-a41d-f9022afd021f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c1e8d4c-ca4e-4c4d-a41d-f9022afd021f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-885660949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c5b18b-f647-4ac9-92f7-8d1080cdeb15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d28b732b8a39472293bb23f6dd663461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:26Z,use_quota=True,user_id='8f79be5dbe3e4664bd276f643d4fa2e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (298b0b7d-399b-483e-954a-9541adf33e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (298b0b7d-399b-483e-954a-9541adf33e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6fc593f-8f51-41f7-9aff-27b38f8b60c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6fc593f-8f51-41f7-9aff-27b38f8b60c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9c5b18b-f647-4ac9-92f7-8d1080cdeb15', 'volume_name': 'volume-f9c5b18b-f647-4ac9-92f7-8d1080cdeb15', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a2b345-d0c8-436d-adbe-f5ac98e1d194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a2b345-d0c8-436d-adbe-f5ac98e1d194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b67b703-2c68-4015-a90a-1b963a777fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:26 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Volume f9c5b18b-f647-4ac9-92f7-8d1080cdeb15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9c5b18b-f647-4ac9-92f7-8d1080cdeb15', 'volume_size': 1} Nov 03 07:34:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-885660949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c5b18b-f647-4ac9-92f7-8d1080cdeb15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d28b732b8a39472293bb23f6dd663461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:26Z,use_quota=True,user_id='8f79be5dbe3e4664bd276f643d4fa2e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:34:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Creating volume f9c5b18b-f647-4ac9-92f7-8d1080cdeb15 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:34:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:34:26 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:34:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9c5b18b-f647-4ac9-92f7-8d1080cdeb15 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:26 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9c5b18b-f647-4ac9-92f7-8d1080cdeb15 1073741824 Nov 03 07:34:26 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:26 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-4bfdda3c-e03a-4c4c-9c72-740c2fff24d1 tempest-GroupSnapshotsTest-1286634275 None] Update group completed successfully. Nov 03 07:34:26 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9c5b18b-f647-4ac9-92f7-8d1080cdeb15 1073741824" returned: 0 in 0.777s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9c5b18b-f647-4ac9-92f7-8d1080cdeb15 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:26 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9c5b18b-f647-4ac9-92f7-8d1080cdeb15 Nov 03 07:34:26 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:27 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9c5b18b-f647-4ac9-92f7-8d1080cdeb15" returned: 0 in 0.332s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b67b703-2c68-4015-a90a-1b963a777fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9c5b18b-f647-4ac9-92f7-8d1080cdeb15', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c53473-ebf6-4e29-bc40-24c87366217b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:27 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Volume volume-f9c5b18b-f647-4ac9-92f7-8d1080cdeb15 (f9c5b18b-f647-4ac9-92f7-8d1080cdeb15): created successfully Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c53473-ebf6-4e29-bc40-24c87366217b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Flow 'volume_create_manager' (73220c19-4d5d-41a5-b492-e3b424b121e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:27 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-e375bd15-ae03-4596-b097-4a64e9d5902a tempest-VolumesListAdminTestJSON-1191152965 None] Created volume successfully. Nov 03 07:34:27 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-73bcfb7c-68a9-4571-99c2-3ea90de0573f tempest-GroupSnapshotsTest-1286634275 None] Update group completed successfully. Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Flow 'volume_create_manager' (37173ebd-c2e3-425f-a528-58835ce41ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7c35c3-d087-4722-9657-4ec74521bd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7c35c3-d087-4722-9657-4ec74521bd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-883432411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9bab26-fa5c-4e13-bdce-b4ff902e1107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80d9d30c8d77479b87300037d7727dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:28Z,use_quota=True,user_id='ade8d34c2cdc4133a09b9f025a27401f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d394e67-deaa-4dea-8884-efc1b0c3a70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d394e67-deaa-4dea-8884-efc1b0c3a70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4473aacb-2554-4473-82f6-4014925b72ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4473aacb-2554-4473-82f6-4014925b72ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd9bab26-fa5c-4e13-bdce-b4ff902e1107', 'volume_name': 'volume-cd9bab26-fa5c-4e13-bdce-b4ff902e1107', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636cc443-fd3c-4d93-949c-69f0fcfa957b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636cc443-fd3c-4d93-949c-69f0fcfa957b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1782dc-e3d3-4844-af57-c64a44bf4009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:27 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Volume cd9bab26-fa5c-4e13-bdce-b4ff902e1107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd9bab26-fa5c-4e13-bdce-b4ff902e1107', 'volume_size': 1} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-883432411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9bab26-fa5c-4e13-bdce-b4ff902e1107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80d9d30c8d77479b87300037d7727dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:28Z,use_quota=True,user_id='ade8d34c2cdc4133a09b9f025a27401f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Creating volume cd9bab26-fa5c-4e13-bdce-b4ff902e1107 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:34:27 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:34:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd9bab26-fa5c-4e13-bdce-b4ff902e1107 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:27 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd9bab26-fa5c-4e13-bdce-b4ff902e1107 1073741824 Nov 03 07:34:27 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:28 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd9bab26-fa5c-4e13-bdce-b4ff902e1107 1073741824" returned: 0 in 0.523s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd9bab26-fa5c-4e13-bdce-b4ff902e1107 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:28 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd9bab26-fa5c-4e13-bdce-b4ff902e1107 Nov 03 07:34:28 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:28 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd9bab26-fa5c-4e13-bdce-b4ff902e1107" returned: 0 in 0.287s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:34:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1782dc-e3d3-4844-af57-c64a44bf4009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd9bab26-fa5c-4e13-bdce-b4ff902e1107', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921a4300-880c-4e7d-a863-7bbc46f68aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:28 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Volume volume-cd9bab26-fa5c-4e13-bdce-b4ff902e1107 (cd9bab26-fa5c-4e13-bdce-b4ff902e1107): created successfully Nov 03 07:34:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921a4300-880c-4e7d-a863-7bbc46f68aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Flow 'volume_create_manager' (37173ebd-c2e3-425f-a528-58835ce41ebb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:28 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-2d944126-4e59-4154-8234-9d06bb2a3a65 tempest-VolumesMetadataTest-521594089 None] Created volume successfully. Nov 03 07:34:28 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-d70f98d5-d976-4e8c-a8cd-718617b4c766 tempest-GroupSnapshotsTest-1286634275 None] Update group completed successfully. Nov 03 07:34:28 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Flow 'volume_create_manager' (75eb318e-5396-4fa6-b482-e8a1fc26630b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e8b31a-69ba-47c5-9b45-2953bf9f43d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e8b31a-69ba-47c5-9b45-2953bf9f43d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88e104d32f646c4bdd41838a948a8ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:29Z,use_quota=True,user_id='efb7516f3d6b4b1a8361425e92c64ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52907ae1-a2ff-4880-b0f1-26d061fc7083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52907ae1-a2ff-4880-b0f1-26d061fc7083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a695881-087f-472a-9d76-56323599d187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a695881-087f-472a-9d76-56323599d187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9', 'volume_name': 'volume-5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ceffd1-63a9-4bed-89bb-8ef251b4d823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ceffd1-63a9-4bed-89bb-8ef251b4d823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de5eb598-fd1d-4e00-92cc-023e761f859b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:29 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Volume 5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9', 'volume_size': 1} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88e104d32f646c4bdd41838a948a8ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:29Z,use_quota=True,user_id='efb7516f3d6b4b1a8361425e92c64ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Creating volume 5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:34:29 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:29 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9 1073741824 Nov 03 07:34:29 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:29 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9 1073741824" returned: 0 in 0.450s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:29 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9 Nov 03 07:34:29 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:29 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9" returned: 0 in 0.304s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de5eb598-fd1d-4e00-92cc-023e761f859b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3faefac7-58cd-4e82-b0a3-d125ee45d40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:29 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Volume volume-5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9 (5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9): created successfully Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3faefac7-58cd-4e82-b0a3-d125ee45d40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Flow 'volume_create_manager' (75eb318e-5396-4fa6-b482-e8a1fc26630b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:29 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ac480ad8-42de-498e-808a-0ad5ed8878d4 tempest-VolumesListAdminTestJSON-1350967983 None] Created volume successfully. Nov 03 07:34:30 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-48f5ae78-1e04-44a0-ad8a-cd5cf7e5ba92 tempest-GroupSnapshotsTest-1286634275 None] Update group completed successfully. Nov 03 07:34:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-63902267-7e38-408e-85c6-6af981ebcd0e tempest-VolumesMetadataTest-521594089 None] Acquiring lock "cinder-cd9bab26-fa5c-4e13-bdce-b4ff902e1107-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-63902267-7e38-408e-85c6-6af981ebcd0e tempest-VolumesMetadataTest-521594089 None] Lock "cinder-cd9bab26-fa5c-4e13-bdce-b4ff902e1107-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-63902267-7e38-408e-85c6-6af981ebcd0e tempest-VolumesMetadataTest-521594089 None] Acquiring lock "cinder-quobyte-cd9bab26-fa5c-4e13-bdce-b4ff902e1107" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-63902267-7e38-408e-85c6-6af981ebcd0e tempest-VolumesMetadataTest-521594089 None] Lock "cinder-quobyte-cd9bab26-fa5c-4e13-bdce-b4ff902e1107" acquired by "delete_volume" :: waited 0.021s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:30 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6c62bb-6a86-4191-8b99-0294773b2c24]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-63902267-7e38-408e-85c6-6af981ebcd0e tempest-VolumesMetadataTest-521594089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd9bab26-fa5c-4e13-bdce-b4ff902e1107 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:30 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd9bab26-fa5c-4e13-bdce-b4ff902e1107 Nov 03 07:34:30 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:31 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-63902267-7e38-408e-85c6-6af981ebcd0e tempest-VolumesMetadataTest-521594089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd9bab26-fa5c-4e13-bdce-b4ff902e1107" returned: 0 in 0.389s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-63902267-7e38-408e-85c6-6af981ebcd0e tempest-VolumesMetadataTest-521594089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd9bab26-fa5c-4e13-bdce-b4ff902e1107 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:31 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd9bab26-fa5c-4e13-bdce-b4ff902e1107 Nov 03 07:34:31 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ad6e0cd1-f1ac-46f7-9a06-e8c24b6bdb5d tempest-VolumesListAdminTestJSON-1350967983 None] Acquiring lock "cinder-5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ad6e0cd1-f1ac-46f7-9a06-e8c24b6bdb5d tempest-VolumesListAdminTestJSON-1350967983 None] Lock "cinder-5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ad6e0cd1-f1ac-46f7-9a06-e8c24b6bdb5d tempest-VolumesListAdminTestJSON-1350967983 None] Acquiring lock "cinder-quobyte-5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ad6e0cd1-f1ac-46f7-9a06-e8c24b6bdb5d tempest-VolumesListAdminTestJSON-1350967983 None] Lock "cinder-quobyte-5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9" acquired by "delete_volume" :: waited 0.027s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-8e4f1b55-2c15-4d7f-bc53-d29873ddae28 tempest-VolumesListAdminTestJSON-1191152965 None] Acquiring lock "cinder-f9c5b18b-f647-4ac9-92f7-8d1080cdeb15-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-8e4f1b55-2c15-4d7f-bc53-d29873ddae28 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "cinder-f9c5b18b-f647-4ac9-92f7-8d1080cdeb15-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:31 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9c398f-15a3-4684-9840-56e3accba552]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:31 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ad6e0cd1-f1ac-46f7-9a06-e8c24b6bdb5d tempest-VolumesListAdminTestJSON-1350967983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-63902267-7e38-408e-85c6-6af981ebcd0e tempest-VolumesMetadataTest-521594089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd9bab26-fa5c-4e13-bdce-b4ff902e1107" returned: 0 in 0.368s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-8e4f1b55-2c15-4d7f-bc53-d29873ddae28 tempest-VolumesListAdminTestJSON-1191152965 None] Acquiring lock "cinder-quobyte-f9c5b18b-f647-4ac9-92f7-8d1080cdeb15" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-63902267-7e38-408e-85c6-6af981ebcd0e tempest-VolumesMetadataTest-521594089 None] Lock "cinder-quobyte-cd9bab26-fa5c-4e13-bdce-b4ff902e1107" released by "delete_volume" :: held 0.814s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-8e4f1b55-2c15-4d7f-bc53-d29873ddae28 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "cinder-quobyte-f9c5b18b-f647-4ac9-92f7-8d1080cdeb15" acquired by "delete_volume" :: waited 0.030s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:31 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[98892b5b-6a8c-4fc2-9673-c1f8ce13a895]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8e4f1b55-2c15-4d7f-bc53-d29873ddae28 tempest-VolumesListAdminTestJSON-1191152965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9c5b18b-f647-4ac9-92f7-8d1080cdeb15 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:31 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9 Nov 03 07:34:31 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:31 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-63902267-7e38-408e-85c6-6af981ebcd0e tempest-VolumesMetadataTest-521594089 None] Created reservations ['9dcf871f-0097-48fd-be26-8a80ab3eb230', 'ffca3780-faa0-43d4-8ec6-8ccbfb54a1cc', 'c5637a12-481a-4eb4-bbc0-3cecd640a063', '66c12e86-2025-487d-8395-325627088c9b'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:31 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9c5b18b-f647-4ac9-92f7-8d1080cdeb15 Nov 03 07:34:31 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-63902267-7e38-408e-85c6-6af981ebcd0e tempest-VolumesMetadataTest-521594089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-63902267-7e38-408e-85c6-6af981ebcd0e tempest-VolumesMetadataTest-521594089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:31 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-63902267-7e38-408e-85c6-6af981ebcd0e tempest-VolumesMetadataTest-521594089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:31 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-63902267-7e38-408e-85c6-6af981ebcd0e tempest-VolumesMetadataTest-521594089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-63902267-7e38-408e-85c6-6af981ebcd0e tempest-VolumesMetadataTest-521594089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-63902267-7e38-408e-85c6-6af981ebcd0e tempest-VolumesMetadataTest-521594089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:31 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:34:31 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:31 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] GroupSnapshot 17aa9a9f-365d-442a-80f7-5ad9c8dcac1f: creating. Nov 03 07:34:32 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ad6e0cd1-f1ac-46f7-9a06-e8c24b6bdb5d tempest-VolumesListAdminTestJSON-1350967983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9" returned: 0 in 0.538s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ad6e0cd1-f1ac-46f7-9a06-e8c24b6bdb5d tempest-VolumesListAdminTestJSON-1350967983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] Group snapshot 17aa9a9f-365d-442a-80f7-5ad9c8dcac1f: creating. {{(pid=87016) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:32 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9 Nov 03 07:34:32 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] Creating offline snapshot 44445d10-3bdd-46d6-92b0-870041c856f1 of volume 8dc76109-7b39-4dbf-8391-8b361a83743d {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[316a32c8-d4a2-4e92-9c2d-1881f5b065a9]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:32 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8e4f1b55-2c15-4d7f-bc53-d29873ddae28 tempest-VolumesListAdminTestJSON-1191152965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9c5b18b-f647-4ac9-92f7-8d1080cdeb15" returned: 0 in 0.562s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8e4f1b55-2c15-4d7f-bc53-d29873ddae28 tempest-VolumesListAdminTestJSON-1191152965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9c5b18b-f647-4ac9-92f7-8d1080cdeb15 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:32 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-63902267-7e38-408e-85c6-6af981ebcd0e tempest-VolumesMetadataTest-521594089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.421s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-63902267-7e38-408e-85c6-6af981ebcd0e tempest-VolumesMetadataTest-521594089 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:32 devstack sudo[98994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9c5b18b-f647-4ac9-92f7-8d1080cdeb15 Nov 03 07:34:32 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:32 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-63902267-7e38-408e-85c6-6af981ebcd0e tempest-VolumesMetadataTest-521594089 None] Deleted volume successfully. Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-63902267-7e38-408e-85c6-6af981ebcd0e tempest-VolumesMetadataTest-521594089 None] Lock "cinder-cd9bab26-fa5c-4e13-bdce-b4ff902e1107-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:32 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d Nov 03 07:34:32 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:32 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ad6e0cd1-f1ac-46f7-9a06-e8c24b6bdb5d tempest-VolumesListAdminTestJSON-1350967983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9" returned: 0 in 0.375s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ad6e0cd1-f1ac-46f7-9a06-e8c24b6bdb5d tempest-VolumesListAdminTestJSON-1350967983 None] Lock "cinder-quobyte-5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9" released by "delete_volume" :: held 1.007s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-ad6e0cd1-f1ac-46f7-9a06-e8c24b6bdb5d tempest-VolumesListAdminTestJSON-1350967983 None] Created reservations ['3c9b434f-1da0-491f-8700-2cc78b9504cc', '877cb410-65d9-4f39-ab01-35e0ff0b4b91', '2a7074a1-ba80-470b-b9a3-8c1c1dca337c', 'ab78f6c0-7f4f-4b6b-9572-544b294efa4c'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ad6e0cd1-f1ac-46f7-9a06-e8c24b6bdb5d tempest-VolumesListAdminTestJSON-1350967983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ad6e0cd1-f1ac-46f7-9a06-e8c24b6bdb5d tempest-VolumesListAdminTestJSON-1350967983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ad6e0cd1-f1ac-46f7-9a06-e8c24b6bdb5d tempest-VolumesListAdminTestJSON-1350967983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ad6e0cd1-f1ac-46f7-9a06-e8c24b6bdb5d tempest-VolumesListAdminTestJSON-1350967983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ad6e0cd1-f1ac-46f7-9a06-e8c24b6bdb5d tempest-VolumesListAdminTestJSON-1350967983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ad6e0cd1-f1ac-46f7-9a06-e8c24b6bdb5d tempest-VolumesListAdminTestJSON-1350967983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:32 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8e4f1b55-2c15-4d7f-bc53-d29873ddae28 tempest-VolumesListAdminTestJSON-1191152965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9c5b18b-f647-4ac9-92f7-8d1080cdeb15" returned: 0 in 0.457s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:32 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:34:32 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-8e4f1b55-2c15-4d7f-bc53-d29873ddae28 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "cinder-quobyte-f9c5b18b-f647-4ac9-92f7-8d1080cdeb15" released by "delete_volume" :: held 1.088s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:32 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d" returned: 0 in 0.560s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.44445d10-3bdd-46d6-92b0-870041c856f1 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:32 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.44445d10-3bdd-46d6-92b0-870041c856f1 1G Nov 03 07:34:32 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-8e4f1b55-2c15-4d7f-bc53-d29873ddae28 tempest-VolumesListAdminTestJSON-1191152965 None] Created reservations ['3b5b2cfd-cb85-4421-b192-96a6dc7da640', '58401517-af71-48c2-b11c-b06a3565aad8', '927b9725-3ee6-4c69-a1ab-bdd0a2ded625', '8f57b09c-c40d-427a-864c-cd92af1611ff'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8e4f1b55-2c15-4d7f-bc53-d29873ddae28 tempest-VolumesListAdminTestJSON-1191152965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8e4f1b55-2c15-4d7f-bc53-d29873ddae28 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8e4f1b55-2c15-4d7f-bc53-d29873ddae28 tempest-VolumesListAdminTestJSON-1191152965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8e4f1b55-2c15-4d7f-bc53-d29873ddae28 tempest-VolumesListAdminTestJSON-1191152965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8e4f1b55-2c15-4d7f-bc53-d29873ddae28 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8e4f1b55-2c15-4d7f-bc53-d29873ddae28 tempest-VolumesListAdminTestJSON-1191152965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:32 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:34:32 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:32 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ad6e0cd1-f1ac-46f7-9a06-e8c24b6bdb5d tempest-VolumesListAdminTestJSON-1350967983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.321s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-ad6e0cd1-f1ac-46f7-9a06-e8c24b6bdb5d tempest-VolumesListAdminTestJSON-1350967983 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:32 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ad6e0cd1-f1ac-46f7-9a06-e8c24b6bdb5d tempest-VolumesListAdminTestJSON-1350967983 None] Deleted volume successfully. Nov 03 07:34:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ad6e0cd1-f1ac-46f7-9a06-e8c24b6bdb5d tempest-VolumesListAdminTestJSON-1350967983 None] Lock "cinder-5ed96e92-05ad-407d-89f4-5bc4ba2a6fe9-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:33 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8e4f1b55-2c15-4d7f-bc53-d29873ddae28 tempest-VolumesListAdminTestJSON-1191152965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.315s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:33 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-8e4f1b55-2c15-4d7f-bc53-d29873ddae28 tempest-VolumesListAdminTestJSON-1191152965 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:33 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-8e4f1b55-2c15-4d7f-bc53-d29873ddae28 tempest-VolumesListAdminTestJSON-1191152965 None] Deleted volume successfully. Nov 03 07:34:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-8e4f1b55-2c15-4d7f-bc53-d29873ddae28 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "cinder-f9c5b18b-f647-4ac9-92f7-8d1080cdeb15-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:33 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.44445d10-3bdd-46d6-92b0-870041c856f1 1G" returned: 0 in 0.558s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dc76109-7b39-4dbf-8391-8b361a83743d -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.44445d10-3bdd-46d6-92b0-870041c856f1 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:33 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dc76109-7b39-4dbf-8391-8b361a83743d -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.44445d10-3bdd-46d6-92b0-870041c856f1 Nov 03 07:34:33 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:33 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dc76109-7b39-4dbf-8391-8b361a83743d -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.44445d10-3bdd-46d6-92b0-870041c856f1" returned: 0 in 0.349s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:33 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.44445d10-3bdd-46d6-92b0-870041c856f1 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:34:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.44445d10-3bdd-46d6-92b0-870041c856f1 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:33 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.44445d10-3bdd-46d6-92b0-870041c856f1 Nov 03 07:34:33 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1d775d0e-17fe-41b9-a4e0-6d7030826757 tempest-VolumesListAdminTestJSON-1191152965 None] Acquiring lock "cinder-21612e07-ae47-4782-905d-23af45942d66-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1d775d0e-17fe-41b9-a4e0-6d7030826757 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "cinder-21612e07-ae47-4782-905d-23af45942d66-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1d775d0e-17fe-41b9-a4e0-6d7030826757 tempest-VolumesListAdminTestJSON-1191152965 None] Acquiring lock "cinder-quobyte-21612e07-ae47-4782-905d-23af45942d66" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1d775d0e-17fe-41b9-a4e0-6d7030826757 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "cinder-quobyte-21612e07-ae47-4782-905d-23af45942d66" acquired by "delete_volume" :: waited 0.020s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:33 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.44445d10-3bdd-46d6-92b0-870041c856f1" returned: 0 in 0.370s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:33 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5046b4-7547-460c-8151-6a70ee311216]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1d775d0e-17fe-41b9-a4e0-6d7030826757 tempest-VolumesListAdminTestJSON-1191152965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-21612e07-ae47-4782-905d-23af45942d66 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:34 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.info Nov 03 07:34:34 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:34 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-21612e07-ae47-4782-905d-23af45942d66 Nov 03 07:34:34 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:34 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.info" returned: 0 in 0.323s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:34 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:34:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:34 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.info Nov 03 07:34:34 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:34 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1d775d0e-17fe-41b9-a4e0-6d7030826757 tempest-VolumesListAdminTestJSON-1191152965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-21612e07-ae47-4782-905d-23af45942d66" returned: 0 in 0.534s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1d775d0e-17fe-41b9-a4e0-6d7030826757 tempest-VolumesListAdminTestJSON-1191152965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-21612e07-ae47-4782-905d-23af45942d66 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:34 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-21612e07-ae47-4782-905d-23af45942d66 Nov 03 07:34:34 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:34 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.info" returned: 0 in 0.349s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.641s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] Creating offline snapshot fb78d057-64ce-4e48-afc5-1f69ede17bbb of volume 33a10506-1a2e-4e90-87b5-155dd2649bb7 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:34:34 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[6006e5e9-b3e1-430b-8e53-4936e80ef383]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:34 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1d775d0e-17fe-41b9-a4e0-6d7030826757 tempest-VolumesListAdminTestJSON-1191152965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-21612e07-ae47-4782-905d-23af45942d66" returned: 0 in 0.319s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:34 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7 Nov 03 07:34:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1d775d0e-17fe-41b9-a4e0-6d7030826757 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "cinder-quobyte-21612e07-ae47-4782-905d-23af45942d66" released by "delete_volume" :: held 0.954s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:34 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:34 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-1d775d0e-17fe-41b9-a4e0-6d7030826757 tempest-VolumesListAdminTestJSON-1191152965 None] Created reservations ['0bc6ec06-ac74-43c4-a2e7-ca08733a3fe3', '0fbee6a6-b7e4-4bbb-8bbf-5216876fea72', '92651ed8-bf13-461e-8ed4-b38dcd111c55', '2c0cb3e6-9e24-43fa-a145-d663f1545c23'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1d775d0e-17fe-41b9-a4e0-6d7030826757 tempest-VolumesListAdminTestJSON-1191152965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1d775d0e-17fe-41b9-a4e0-6d7030826757 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1d775d0e-17fe-41b9-a4e0-6d7030826757 tempest-VolumesListAdminTestJSON-1191152965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1d775d0e-17fe-41b9-a4e0-6d7030826757 tempest-VolumesListAdminTestJSON-1191152965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1d775d0e-17fe-41b9-a4e0-6d7030826757 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1d775d0e-17fe-41b9-a4e0-6d7030826757 tempest-VolumesListAdminTestJSON-1191152965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:35 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:34:35 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:35 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7" returned: 0 in 0.558s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.fb78d057-64ce-4e48-afc5-1f69ede17bbb 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:35 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.fb78d057-64ce-4e48-afc5-1f69ede17bbb 1G Nov 03 07:34:35 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:35 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1d775d0e-17fe-41b9-a4e0-6d7030826757 tempest-VolumesListAdminTestJSON-1191152965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.480s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:35 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-1d775d0e-17fe-41b9-a4e0-6d7030826757 tempest-VolumesListAdminTestJSON-1191152965 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:35 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-1d775d0e-17fe-41b9-a4e0-6d7030826757 tempest-VolumesListAdminTestJSON-1191152965 None] Deleted volume successfully. Nov 03 07:34:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1d775d0e-17fe-41b9-a4e0-6d7030826757 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "cinder-21612e07-ae47-4782-905d-23af45942d66-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:36 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.fb78d057-64ce-4e48-afc5-1f69ede17bbb 1G" returned: 0 in 0.829s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33a10506-1a2e-4e90-87b5-155dd2649bb7 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.fb78d057-64ce-4e48-afc5-1f69ede17bbb {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:36 devstack sudo[99051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33a10506-1a2e-4e90-87b5-155dd2649bb7 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.fb78d057-64ce-4e48-afc5-1f69ede17bbb Nov 03 07:34:36 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-01ce89a5-5c18-48ec-9696-efaf3f9abff6 tempest-VolumesListAdminTestJSON-1191152965 None] Acquiring lock "cinder-f2b03339-b4b9-44f0-9556-dda114c6c8a5-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-01ce89a5-5c18-48ec-9696-efaf3f9abff6 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "cinder-f2b03339-b4b9-44f0-9556-dda114c6c8a5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-01ce89a5-5c18-48ec-9696-efaf3f9abff6 tempest-VolumesListAdminTestJSON-1191152965 None] Acquiring lock "cinder-quobyte-f2b03339-b4b9-44f0-9556-dda114c6c8a5" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-01ce89a5-5c18-48ec-9696-efaf3f9abff6 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "cinder-quobyte-f2b03339-b4b9-44f0-9556-dda114c6c8a5" acquired by "delete_volume" :: waited 0.062s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:36 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8dbf825-a7ee-4123-aca1-ef0e72755a18]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-01ce89a5-5c18-48ec-9696-efaf3f9abff6 tempest-VolumesListAdminTestJSON-1191152965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f2b03339-b4b9-44f0-9556-dda114c6c8a5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:36 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f2b03339-b4b9-44f0-9556-dda114c6c8a5 Nov 03 07:34:36 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:36 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33a10506-1a2e-4e90-87b5-155dd2649bb7 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.fb78d057-64ce-4e48-afc5-1f69ede17bbb" returned: 0 in 0.580s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:36 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.fb78d057-64ce-4e48-afc5-1f69ede17bbb is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:34:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.fb78d057-64ce-4e48-afc5-1f69ede17bbb {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:36 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.fb78d057-64ce-4e48-afc5-1f69ede17bbb Nov 03 07:34:36 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:36 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-01ce89a5-5c18-48ec-9696-efaf3f9abff6 tempest-VolumesListAdminTestJSON-1191152965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f2b03339-b4b9-44f0-9556-dda114c6c8a5" returned: 0 in 0.465s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-01ce89a5-5c18-48ec-9696-efaf3f9abff6 tempest-VolumesListAdminTestJSON-1191152965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f2b03339-b4b9-44f0-9556-dda114c6c8a5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:37 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f2b03339-b4b9-44f0-9556-dda114c6c8a5 Nov 03 07:34:37 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:37 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.fb78d057-64ce-4e48-afc5-1f69ede17bbb" returned: 0 in 0.366s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:37 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.info Nov 03 07:34:37 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:37 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-01ce89a5-5c18-48ec-9696-efaf3f9abff6 tempest-VolumesListAdminTestJSON-1191152965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f2b03339-b4b9-44f0-9556-dda114c6c8a5" returned: 0 in 0.344s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-01ce89a5-5c18-48ec-9696-efaf3f9abff6 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "cinder-quobyte-f2b03339-b4b9-44f0-9556-dda114c6c8a5" released by "delete_volume" :: held 0.875s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:37 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-01ce89a5-5c18-48ec-9696-efaf3f9abff6 tempest-VolumesListAdminTestJSON-1191152965 None] Created reservations ['563fe326-5f12-4fa4-87e9-e45cc73adb39', 'e1451410-272c-42f5-94fb-25768ebd44b9', '1b59cf61-4ad5-4cd2-bf8a-12c5b7cc4100', '0ef5caee-8de6-4ac5-92ef-7168ad2cb299'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:37 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.info" returned: 0 in 0.356s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:37 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:34:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:37 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.info Nov 03 07:34:37 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-01ce89a5-5c18-48ec-9696-efaf3f9abff6 tempest-VolumesListAdminTestJSON-1191152965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-01ce89a5-5c18-48ec-9696-efaf3f9abff6 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:37 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-01ce89a5-5c18-48ec-9696-efaf3f9abff6 tempest-VolumesListAdminTestJSON-1191152965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:37 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-01ce89a5-5c18-48ec-9696-efaf3f9abff6 tempest-VolumesListAdminTestJSON-1191152965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-01ce89a5-5c18-48ec-9696-efaf3f9abff6 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-01ce89a5-5c18-48ec-9696-efaf3f9abff6 tempest-VolumesListAdminTestJSON-1191152965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:37 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:34:37 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:37 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.info" returned: 0 in 0.408s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.212s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:38 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-01ce89a5-5c18-48ec-9696-efaf3f9abff6 tempest-VolumesListAdminTestJSON-1191152965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.467s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:38 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-01ce89a5-5c18-48ec-9696-efaf3f9abff6 tempest-VolumesListAdminTestJSON-1191152965 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:38 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-01ce89a5-5c18-48ec-9696-efaf3f9abff6 tempest-VolumesListAdminTestJSON-1191152965 None] Deleted volume successfully. Nov 03 07:34:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-01ce89a5-5c18-48ec-9696-efaf3f9abff6 tempest-VolumesListAdminTestJSON-1191152965 None] Lock "cinder-f2b03339-b4b9-44f0-9556-dda114c6c8a5-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:38 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ea094ebc-f3d0-43ab-9be8-0d373fe1526f tempest-GroupSnapshotsTest-1286634275 None] group_snapshot 17aa9a9f-365d-442a-80f7-5ad9c8dcac1f: created successfully Nov 03 07:34:38 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] group_snapshot 17aa9a9f-365d-442a-80f7-5ad9c8dcac1f: deleting Nov 03 07:34:38 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] group_snapshot 17aa9a9f-365d-442a-80f7-5ad9c8dcac1f: deleting {{(pid=87016) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 07:34:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "cinder-quobyte-8dc76109-7b39-4dbf-8391-8b361a83743d" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-8dc76109-7b39-4dbf-8391-8b361a83743d" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "cinder-quobyte-44445d10-3bdd-46d6-92b0-870041c856f1" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-44445d10-3bdd-46d6-92b0-870041c856f1" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:38 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Deleting offline snapshot 44445d10-3bdd-46d6-92b0-870041c856f1 of volume 8dc76109-7b39-4dbf-8391-8b361a83743d {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:34:38 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] snapshot_file for this snap is: volume-8dc76109-7b39-4dbf-8391-8b361a83743d.44445d10-3bdd-46d6-92b0-870041c856f1 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:34:38 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffb23ec-726d-44d8-9af8-210d225a33ee]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.44445d10-3bdd-46d6-92b0-870041c856f1 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:39 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.44445d10-3bdd-46d6-92b0-870041c856f1 Nov 03 07:34:39 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:39 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.44445d10-3bdd-46d6-92b0-870041c856f1" returned: 0 in 0.770s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dc76109-7b39-4dbf-8391-8b361a83743d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:34:39 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[972e2873-899e-4f66-ba38-bc9aab8ea136]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:39 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d Nov 03 07:34:39 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Flow 'volume_create_manager' (063cb185-bda7-42d2-a9ea-c6f1e6634a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20fb9d9-b3d3-4344-bad0-b083c90031c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20fb9d9-b3d3-4344-bad0-b083c90031c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-292101792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc62ba7-9570-41c4-8121-566a9613ab8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17918fa5228e482da5742906d7505b91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:40Z,use_quota=True,user_id='a26f9e807226467883732d395841f5f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441b2bfd-1c8d-42b2-892e-82aecb8efd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441b2bfd-1c8d-42b2-892e-82aecb8efd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e0e6cc5-4073-499e-bf25-2c80fb95ea9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e0e6cc5-4073-499e-bf25-2c80fb95ea9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccc62ba7-9570-41c4-8121-566a9613ab8a', 'volume_name': 'volume-ccc62ba7-9570-41c4-8121-566a9613ab8a', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fcf571-3b50-49bd-b5d5-d00a0eb850aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fcf571-3b50-49bd-b5d5-d00a0eb850aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c991e37-59c2-4eef-90c1-9e323024a1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:40 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Volume ccc62ba7-9570-41c4-8121-566a9613ab8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccc62ba7-9570-41c4-8121-566a9613ab8a', 'volume_size': 1} Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-292101792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc62ba7-9570-41c4-8121-566a9613ab8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17918fa5228e482da5742906d7505b91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:40Z,use_quota=True,user_id='a26f9e807226467883732d395841f5f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Creating volume ccc62ba7-9570-41c4-8121-566a9613ab8a {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:34:40 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ccc62ba7-9570-41c4-8121-566a9613ab8a 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:40 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d" returned: 0 in 0.660s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.44445d10-3bdd-46d6-92b0-870041c856f1 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:40 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ccc62ba7-9570-41c4-8121-566a9613ab8a 1073741824 Nov 03 07:34:40 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:40 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.44445d10-3bdd-46d6-92b0-870041c856f1 Nov 03 07:34:40 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:40 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.44445d10-3bdd-46d6-92b0-870041c856f1" returned: 0 in 0.567s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.44445d10-3bdd-46d6-92b0-870041c856f1 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-40117c13-b4ea-4a12-b842-b1bd1de203a0 req-fc80eeed-9e1c-4763-a955-97a10488b4e3 tempest-TestInstancesWithCinderVolumes-719158012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:41 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.44445d10-3bdd-46d6-92b0-870041c856f1 Nov 03 07:34:41 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:41 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ccc62ba7-9570-41c4-8121-566a9613ab8a 1073741824" returned: 0 in 0.709s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ccc62ba7-9570-41c4-8121-566a9613ab8a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:41 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ccc62ba7-9570-41c4-8121-566a9613ab8a Nov 03 07:34:41 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:41 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d.44445d10-3bdd-46d6-92b0-870041c856f1" returned: 0 in 0.322s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-44445d10-3bdd-46d6-92b0-870041c856f1" released by "_delete_snapshot" :: held 2.512s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-8dc76109-7b39-4dbf-8391-8b361a83743d" released by "delete_snapshot" :: held 2.547s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "cinder-quobyte-33a10506-1a2e-4e90-87b5-155dd2649bb7" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-33a10506-1a2e-4e90-87b5-155dd2649bb7" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "cinder-quobyte-fb78d057-64ce-4e48-afc5-1f69ede17bbb" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-fb78d057-64ce-4e48-afc5-1f69ede17bbb" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Deleting offline snapshot fb78d057-64ce-4e48-afc5-1f69ede17bbb of volume 33a10506-1a2e-4e90-87b5-155dd2649bb7 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] snapshot_file for this snap is: volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.fb78d057-64ce-4e48-afc5-1f69ede17bbb {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:34:41 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ccc62ba7-9570-41c4-8121-566a9613ab8a" returned: 0 in 0.355s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1dd8d4-58f0-4a9e-8ca1-bfdfa465211a]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-40117c13-b4ea-4a12-b842-b1bd1de203a0 req-fc80eeed-9e1c-4763-a955-97a10488b4e3 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.488s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.fb78d057-64ce-4e48-afc5-1f69ede17bbb {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c991e37-59c2-4eef-90c1-9e323024a1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccc62ba7-9570-41c4-8121-566a9613ab8a', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07184d7a-6b0a-4cd3-b7b4-406a1aab24f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-40117c13-b4ea-4a12-b842-b1bd1de203a0 req-fc80eeed-9e1c-4763-a955-97a10488b4e3 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.064s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:41 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Volume volume-ccc62ba7-9570-41c4-8121-566a9613ab8a (ccc62ba7-9570-41c4-8121-566a9613ab8a): created successfully Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07184d7a-6b0a-4cd3-b7b4-406a1aab24f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Flow 'volume_create_manager' (063cb185-bda7-42d2-a9ea-c6f1e6634a52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-40117c13-b4ea-4a12-b842-b1bd1de203a0 req-fc80eeed-9e1c-4763-a955-97a10488b4e3 tempest-TestInstancesWithCinderVolumes-719158012 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14', 'name': 'volume-d8c4f774-2b77-4d46-b2d1-88f594a6f34c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b6e0c35d-de61-4677-90d0-4fc4fbdf2b7f', 'enforce_multipath': True} {{(pid=87016) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:34:41 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-d2cd767c-7e41-4c3c-b9ac-0b947f24e1a6 tempest-VolumesTransfersTest-2142283847 None] Created volume successfully. Nov 03 07:34:41 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.fb78d057-64ce-4e48-afc5-1f69ede17bbb Nov 03 07:34:41 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:41 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-40117c13-b4ea-4a12-b842-b1bd1de203a0 req-fc80eeed-9e1c-4763-a955-97a10488b4e3 tempest-TestInstancesWithCinderVolumes-719158012 None] attachment_update completed successfully. Nov 03 07:34:42 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.fb78d057-64ce-4e48-afc5-1f69ede17bbb" returned: 0 in 0.580s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33a10506-1a2e-4e90-87b5-155dd2649bb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:34:42 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1a1e8f-4887-4bca-96f8-10253c793c1e]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:42 devstack sudo[99135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7 Nov 03 07:34:42 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:42 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7" returned: 0 in 0.483s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.fb78d057-64ce-4e48-afc5-1f69ede17bbb {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:42 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.fb78d057-64ce-4e48-afc5-1f69ede17bbb Nov 03 07:34:42 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:43 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.fb78d057-64ce-4e48-afc5-1f69ede17bbb" returned: 0 in 0.515s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.fb78d057-64ce-4e48-afc5-1f69ede17bbb {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:43 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.fb78d057-64ce-4e48-afc5-1f69ede17bbb Nov 03 07:34:43 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:43 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7.fb78d057-64ce-4e48-afc5-1f69ede17bbb" returned: 0 in 0.376s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:43 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-7d41212a-2b43-4fe5-b0cc-51680bc2decb tempest-VolumesTransfersTest-2078427943 None] Transfer volume completed successfully. Nov 03 07:34:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-fb78d057-64ce-4e48-afc5-1f69ede17bbb" released by "_delete_snapshot" :: held 2.167s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-33a10506-1a2e-4e90-87b5-155dd2649bb7" released by "delete_snapshot" :: held 2.207s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:43 devstack cinder-volume[87016]: WARNING cinder.quota [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1364452428 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1364452428, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:34:43 devstack cinder-volume[87016]: WARNING cinder.quota [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1364452428 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1364452428, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:34:43 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Created reservations ['e06ec365-835d-4c16-a300-b0477408391a', 'e7787bf6-3bff-45d2-99ce-f43b7986e62b', 'dc2d8a2a-096b-42a7-98de-e978046298a6', '76a2d86f-33fe-4a5c-b259-02903be49816'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:43 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] Created reservations ['896c7994-e580-4e8e-8035-9323e2e4931c', 'f554b442-a81b-4837-bb5d-80439b0ac030', '57fc6e16-8c97-482a-b778-2cb8efd10788', '42a072bb-1939-4a92-90dd-6921766bb710'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:44 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-286dbd76-c72f-4bb5-8f0a-7eacfad81590 tempest-GroupSnapshotsTest-1286634275 None] group_snapshot 17aa9a9f-365d-442a-80f7-5ad9c8dcac1f: deleted successfully Nov 03 07:34:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-a21c9c93-0113-466b-893b-3dd787013ed2 req-ba1d47c6-c83b-45db-9932-764c5dde7b41 tempest-TestInstancesWithCinderVolumes-719158012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-a21c9c93-0113-466b-893b-3dd787013ed2 req-ba1d47c6-c83b-45db-9932-764c5dde7b41 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-a21c9c93-0113-466b-893b-3dd787013ed2 req-ba1d47c6-c83b-45db-9932-764c5dde7b41 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-a21c9c93-0113-466b-893b-3dd787013ed2 req-ba1d47c6-c83b-45db-9932-764c5dde7b41 tempest-TestInstancesWithCinderVolumes-719158012 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14', 'name': 'volume-9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e9e8772-d021-46af-bcb0-eac813219fb8', 'enforce_multipath': True} {{(pid=87016) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:34:44 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-a21c9c93-0113-466b-893b-3dd787013ed2 req-ba1d47c6-c83b-45db-9932-764c5dde7b41 tempest-TestInstancesWithCinderVolumes-719158012 None] attachment_update completed successfully. Nov 03 07:34:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a6044fa4-aaaa-465b-b5c4-857b9a4de78b tempest-VolumesTransfersTest-1525009298 None] Acquiring lock "cinder-ccc62ba7-9570-41c4-8121-566a9613ab8a-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a6044fa4-aaaa-465b-b5c4-857b9a4de78b tempest-VolumesTransfersTest-1525009298 None] Lock "cinder-ccc62ba7-9570-41c4-8121-566a9613ab8a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a6044fa4-aaaa-465b-b5c4-857b9a4de78b tempest-VolumesTransfersTest-1525009298 None] Acquiring lock "cinder-quobyte-ccc62ba7-9570-41c4-8121-566a9613ab8a" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a6044fa4-aaaa-465b-b5c4-857b9a4de78b tempest-VolumesTransfersTest-1525009298 None] Lock "cinder-quobyte-ccc62ba7-9570-41c4-8121-566a9613ab8a" acquired by "delete_volume" :: waited 0.029s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:44 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9828df8-6f56-46b7-a982-1553395f4539]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a6044fa4-aaaa-465b-b5c4-857b9a4de78b tempest-VolumesTransfersTest-1525009298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ccc62ba7-9570-41c4-8121-566a9613ab8a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:44 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ccc62ba7-9570-41c4-8121-566a9613ab8a Nov 03 07:34:44 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:45 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a6044fa4-aaaa-465b-b5c4-857b9a4de78b tempest-VolumesTransfersTest-1525009298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ccc62ba7-9570-41c4-8121-566a9613ab8a" returned: 0 in 0.591s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a6044fa4-aaaa-465b-b5c4-857b9a4de78b tempest-VolumesTransfersTest-1525009298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ccc62ba7-9570-41c4-8121-566a9613ab8a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:45 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ccc62ba7-9570-41c4-8121-566a9613ab8a Nov 03 07:34:45 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "cinder-quobyte-33a10506-1a2e-4e90-87b5-155dd2649bb7" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-33a10506-1a2e-4e90-87b5-155dd2649bb7" acquired by "delete_volume" :: waited 0.032s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:45 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bd1028-77e7-4907-ae9f-2b4133e450ba]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:45 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a6044fa4-aaaa-465b-b5c4-857b9a4de78b tempest-VolumesTransfersTest-1525009298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ccc62ba7-9570-41c4-8121-566a9613ab8a" returned: 0 in 0.356s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a6044fa4-aaaa-465b-b5c4-857b9a4de78b tempest-VolumesTransfersTest-1525009298 None] Lock "cinder-quobyte-ccc62ba7-9570-41c4-8121-566a9613ab8a" released by "delete_volume" :: held 1.002s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:45 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7 Nov 03 07:34:45 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:45 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-a6044fa4-aaaa-465b-b5c4-857b9a4de78b tempest-VolumesTransfersTest-1525009298 None] Created reservations ['3c3e82bf-dc2b-4fe4-8f05-5ec73220dc92', '2e215dec-82cb-4323-a576-e1cd72417a25', '48d360f2-d317-4086-af8f-a9c31609fe92', 'bf15c5bd-e981-418d-a7d1-9bddb3c4e181'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a6044fa4-aaaa-465b-b5c4-857b9a4de78b tempest-VolumesTransfersTest-1525009298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a6044fa4-aaaa-465b-b5c4-857b9a4de78b tempest-VolumesTransfersTest-1525009298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:45 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a6044fa4-aaaa-465b-b5c4-857b9a4de78b tempest-VolumesTransfersTest-1525009298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:45 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a6044fa4-aaaa-465b-b5c4-857b9a4de78b tempest-VolumesTransfersTest-1525009298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a6044fa4-aaaa-465b-b5c4-857b9a4de78b tempest-VolumesTransfersTest-1525009298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a6044fa4-aaaa-465b-b5c4-857b9a4de78b tempest-VolumesTransfersTest-1525009298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:46 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:34:46 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:46 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7" returned: 0 in 0.497s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:46 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7 Nov 03 07:34:46 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:46 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a6044fa4-aaaa-465b-b5c4-857b9a4de78b tempest-VolumesTransfersTest-1525009298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.295s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:46 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a6044fa4-aaaa-465b-b5c4-857b9a4de78b tempest-VolumesTransfersTest-1525009298 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:46 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a6044fa4-aaaa-465b-b5c4-857b9a4de78b tempest-VolumesTransfersTest-1525009298 None] Deleted volume successfully. Nov 03 07:34:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a6044fa4-aaaa-465b-b5c4-857b9a4de78b tempest-VolumesTransfersTest-1525009298 None] Lock "cinder-ccc62ba7-9570-41c4-8121-566a9613ab8a-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:46 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-33a10506-1a2e-4e90-87b5-155dd2649bb7" returned: 0 in 0.411s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-33a10506-1a2e-4e90-87b5-155dd2649bb7" released by "delete_volume" :: held 1.017s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "cinder-quobyte-8dc76109-7b39-4dbf-8391-8b361a83743d" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-8dc76109-7b39-4dbf-8391-8b361a83743d" acquired by "delete_volume" :: waited 0.026s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:46 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc8db4e-5076-43a6-aac6-d1c5eadd0a33]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:46 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d Nov 03 07:34:46 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:47 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d" returned: 0 in 0.547s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:47 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d Nov 03 07:34:47 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:47 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8dc76109-7b39-4dbf-8391-8b361a83743d" returned: 0 in 0.393s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:47 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-8dc76109-7b39-4dbf-8391-8b361a83743d" released by "delete_volume" :: held 1.043s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:47 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=136,cinder:INSERT=30,cinder:UPDATE=168,cinder:DELETE=6 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:34:47 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=168,cinder:INSERT=49,cinder:UPDATE=144,cinder:DELETE=12 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:34:47 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] Created reservations ['1174bf8a-ceb8-4ddd-9d3d-42ac0b17fbac'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:47 devstack cinder-volume[87016]: WARNING cinder.quota [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1364452428 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1364452428, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:34:47 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Flow 'volume_create_manager' (514028e7-425d-47b4-96a8-769d4d5a16fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2dcbdcc-7ed9-4b41-aa20-52f3dace7dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2dcbdcc-7ed9-4b41-aa20-52f3dace7dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1828700337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa4c02a-06aa-44e7-b8e9-966bad7a250f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17918fa5228e482da5742906d7505b91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:48Z,use_quota=True,user_id='a26f9e807226467883732d395841f5f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c564a682-baff-4acf-9875-c57f97f2146a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c564a682-baff-4acf-9875-c57f97f2146a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e85cc64-7907-4cd6-8a5a-a5164f84ca4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e85cc64-7907-4cd6-8a5a-a5164f84ca4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faa4c02a-06aa-44e7-b8e9-966bad7a250f', 'volume_name': 'volume-faa4c02a-06aa-44e7-b8e9-966bad7a250f', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf19065e-58fc-4473-8c80-fc066b112de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf19065e-58fc-4473-8c80-fc066b112de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe1907c-043e-4540-b9ad-03c3b6a0d44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:48 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Volume faa4c02a-06aa-44e7-b8e9-966bad7a250f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faa4c02a-06aa-44e7-b8e9-966bad7a250f', 'volume_size': 1} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1828700337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa4c02a-06aa-44e7-b8e9-966bad7a250f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17918fa5228e482da5742906d7505b91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:48Z,use_quota=True,user_id='a26f9e807226467883732d395841f5f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Creating volume faa4c02a-06aa-44e7-b8e9-966bad7a250f {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:34:48 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-faa4c02a-06aa-44e7-b8e9-966bad7a250f 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] Created reservations ['8fcb9e14-6c54-4384-a1db-0cb45c22c45a', '0a9c93cb-e0f9-48c1-9179-5472a78483a0', '68a4967b-46fd-4eec-b256-a9e4b499fa6e', 'a3662b26-0e4c-4cf4-b29d-185e88cec0ac'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:48 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-faa4c02a-06aa-44e7-b8e9-966bad7a250f 1073741824 Nov 03 07:34:48 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] Created reservations ['9b171cd7-32d6-4b27-95d2-586e72fa5016', '5748978e-fa5e-4765-9c6f-d74f5e57b58c', '176d97f8-72cf-417a-966e-c9b320948c25', '887ac465-9199-4793-8903-dc31e649bfd7'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:48 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:34:48 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:48 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-faa4c02a-06aa-44e7-b8e9-966bad7a250f 1073741824" returned: 0 in 0.765s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-faa4c02a-06aa-44e7-b8e9-966bad7a250f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:48 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.394s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:48 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:48 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-faa4c02a-06aa-44e7-b8e9-966bad7a250f Nov 03 07:34:48 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:48 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-4a78a618-ac2e-4f89-bf7b-c497c6302bfc tempest-GroupSnapshotsTest-1286634275 None] Delete group completed successfully. Nov 03 07:34:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:34:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:49 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:34:49 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:49 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-faa4c02a-06aa-44e7-b8e9-966bad7a250f" returned: 0 in 0.382s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:34:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe1907c-043e-4540-b9ad-03c3b6a0d44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faa4c02a-06aa-44e7-b8e9-966bad7a250f', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe19dd0-0532-4921-8e7c-83ff9877a56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:49 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Volume volume-faa4c02a-06aa-44e7-b8e9-966bad7a250f (faa4c02a-06aa-44e7-b8e9-966bad7a250f): created successfully Nov 03 07:34:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe19dd0-0532-4921-8e7c-83ff9877a56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Flow 'volume_create_manager' (514028e7-425d-47b4-96a8-769d4d5a16fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:49 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ea06faa0-f8f3-4b11-8142-7347d1048b88 tempest-VolumesTransfersTest-2142283847 None] Created volume successfully. Nov 03 07:34:49 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.363s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:34:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 28 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:34:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:34:50 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-96f47dc5-8892-4191-b022-d830734cefa2 tempest-GroupSnapshotsTest-1286634275 None] Group tempest-GroupSnapshotsTest-Group-1664577690: creating Nov 03 07:34:50 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-96f47dc5-8892-4191-b022-d830734cefa2 tempest-GroupSnapshotsTest-1286634275 None] Group tempest-GroupSnapshotsTest-Group-1664577690: created successfully Nov 03 07:34:50 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-96f47dc5-8892-4191-b022-d830734cefa2 tempest-GroupSnapshotsTest-1286634275 None] Create group completed successfully. Nov 03 07:34:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-739affbb-c8e5-4f51-8724-28e886ae3c12 tempest-VolumesTransfersTest-1525009298 None] Acquiring lock "cinder-faa4c02a-06aa-44e7-b8e9-966bad7a250f-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-739affbb-c8e5-4f51-8724-28e886ae3c12 tempest-VolumesTransfersTest-1525009298 None] Lock "cinder-faa4c02a-06aa-44e7-b8e9-966bad7a250f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-739affbb-c8e5-4f51-8724-28e886ae3c12 tempest-VolumesTransfersTest-1525009298 None] Acquiring lock "cinder-quobyte-faa4c02a-06aa-44e7-b8e9-966bad7a250f" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-739affbb-c8e5-4f51-8724-28e886ae3c12 tempest-VolumesTransfersTest-1525009298 None] Lock "cinder-quobyte-faa4c02a-06aa-44e7-b8e9-966bad7a250f" acquired by "delete_volume" :: waited 0.019s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:50 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c76177-bcf0-4f61-8f06-284e08f09a7b]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-739affbb-c8e5-4f51-8724-28e886ae3c12 tempest-VolumesTransfersTest-1525009298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-faa4c02a-06aa-44e7-b8e9-966bad7a250f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:50 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-faa4c02a-06aa-44e7-b8e9-966bad7a250f Nov 03 07:34:50 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:51 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-739affbb-c8e5-4f51-8724-28e886ae3c12 tempest-VolumesTransfersTest-1525009298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-faa4c02a-06aa-44e7-b8e9-966bad7a250f" returned: 0 in 0.398s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-739affbb-c8e5-4f51-8724-28e886ae3c12 tempest-VolumesTransfersTest-1525009298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-faa4c02a-06aa-44e7-b8e9-966bad7a250f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:51 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-faa4c02a-06aa-44e7-b8e9-966bad7a250f Nov 03 07:34:51 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:51 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-739affbb-c8e5-4f51-8724-28e886ae3c12 tempest-VolumesTransfersTest-1525009298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-faa4c02a-06aa-44e7-b8e9-966bad7a250f" returned: 0 in 0.327s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-739affbb-c8e5-4f51-8724-28e886ae3c12 tempest-VolumesTransfersTest-1525009298 None] Lock "cinder-quobyte-faa4c02a-06aa-44e7-b8e9-966bad7a250f" released by "delete_volume" :: held 0.787s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:51 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-739affbb-c8e5-4f51-8724-28e886ae3c12 tempest-VolumesTransfersTest-1525009298 None] Created reservations ['1675d7c5-6781-43dc-8096-da5226125eb6', '57d2e1cd-fd76-42c2-99be-77497f98b715', '2f5ad2c7-86ed-4935-b366-0bb1d2119351', 'b5c9f36a-33db-4ab0-a4b6-fcb585a13e7c'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-739affbb-c8e5-4f51-8724-28e886ae3c12 tempest-VolumesTransfersTest-1525009298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-739affbb-c8e5-4f51-8724-28e886ae3c12 tempest-VolumesTransfersTest-1525009298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-739affbb-c8e5-4f51-8724-28e886ae3c12 tempest-VolumesTransfersTest-1525009298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-739affbb-c8e5-4f51-8724-28e886ae3c12 tempest-VolumesTransfersTest-1525009298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-739affbb-c8e5-4f51-8724-28e886ae3c12 tempest-VolumesTransfersTest-1525009298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-739affbb-c8e5-4f51-8724-28e886ae3c12 tempest-VolumesTransfersTest-1525009298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:51 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:34:51 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:52 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-739affbb-c8e5-4f51-8724-28e886ae3c12 tempest-VolumesTransfersTest-1525009298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.670s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-739affbb-c8e5-4f51-8724-28e886ae3c12 tempest-VolumesTransfersTest-1525009298 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:52 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-739affbb-c8e5-4f51-8724-28e886ae3c12 tempest-VolumesTransfersTest-1525009298 None] Deleted volume successfully. Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-739affbb-c8e5-4f51-8724-28e886ae3c12 tempest-VolumesTransfersTest-1525009298 None] Lock "cinder-faa4c02a-06aa-44e7-b8e9-966bad7a250f-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Flow 'volume_create_manager' (3f3a308a-2f43-438f-badd-1cf6c2babd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804dbd3a-11b2-461f-9e71-ec551688b332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804dbd3a-11b2-461f-9e71-ec551688b332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1463992071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c283098-4036-4ad3-9a6e-1123aca4b024,host='devstack@QuobyteHD#QuobyteHD',id=e2a02c98-702e-48bd-acdf-6d78deebc6dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc32a96045304dcb8f916b642238b4a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:52Z,use_quota=True,user_id='72707c655e6743ac9d78a00c85b7e5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(704fd5e1-f38a-4b78-8e3f-2bcadec51254),volume_type_id=704fd5e1-f38a-4b78-8e3f-2bcadec51254)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca8f92d4-15a5-4bf7-8c14-577ecf7404f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca8f92d4-15a5-4bf7-8c14-577ecf7404f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05394070-4e91-4083-8141-09be993c9270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05394070-4e91-4083-8141-09be993c9270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2a02c98-702e-48bd-acdf-6d78deebc6dd', 'volume_name': 'volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da30e84-0c8d-43d8-8edc-2fdf1b01a092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da30e84-0c8d-43d8-8edc-2fdf1b01a092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63eab12c-2a8b-4d2b-b0dc-25b6b1a71853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:52 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Volume e2a02c98-702e-48bd-acdf-6d78deebc6dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd', 'volume_size': 1} Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2c283098-4036-4ad3-9a6e-1123aca4b024,created_at=2026-11-03T06:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1463992071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c283098-4036-4ad3-9a6e-1123aca4b024,host='devstack@QuobyteHD#QuobyteHD',id=e2a02c98-702e-48bd-acdf-6d78deebc6dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc32a96045304dcb8f916b642238b4a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:52Z,use_quota=True,user_id='72707c655e6743ac9d78a00c85b7e5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(704fd5e1-f38a-4b78-8e3f-2bcadec51254),volume_type_id=704fd5e1-f38a-4b78-8e3f-2bcadec51254)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Creating volume e2a02c98-702e-48bd-acdf-6d78deebc6dd {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:34:52 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:52 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd 1073741824 Nov 03 07:34:52 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:52 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-972f5ce2-190a-4153-9b12-b968a2baab4a req-aa84db6d-e5b8-404f-aaac-735a7ba46a75 tempest-TestInstancesWithCinderVolumes-719158012 None] Terminate volume connection completed successfully. Nov 03 07:34:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-972f5ce2-190a-4153-9b12-b968a2baab4a req-aa84db6d-e5b8-404f-aaac-735a7ba46a75 tempest-TestInstancesWithCinderVolumes-719158012 None] Deleting attachment b6e0c35d-de61-4677-90d0-4fc4fbdf2b7f. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:34:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5be63b98-1d77-4498-8188-51d7e3a37521 tempest-TestInstancesWithCinderVolumes-719158012 None] Acquiring lock "cinder-d8c4f774-2b77-4d46-b2d1-88f594a6f34c-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5be63b98-1d77-4498-8188-51d7e3a37521 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "cinder-d8c4f774-2b77-4d46-b2d1-88f594a6f34c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:53 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd 1073741824" returned: 0 in 0.762s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5be63b98-1d77-4498-8188-51d7e3a37521 tempest-TestInstancesWithCinderVolumes-719158012 None] Acquiring lock "cinder-quobyte-d8c4f774-2b77-4d46-b2d1-88f594a6f34c" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5be63b98-1d77-4498-8188-51d7e3a37521 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "cinder-quobyte-d8c4f774-2b77-4d46-b2d1-88f594a6f34c" acquired by "delete_volume" :: waited 0.031s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:53 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bd265e-a72c-4a10-98a6-1e54dc3b7304]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5be63b98-1d77-4498-8188-51d7e3a37521 tempest-TestInstancesWithCinderVolumes-719158012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8c4f774-2b77-4d46-b2d1-88f594a6f34c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:53 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd Nov 03 07:34:53 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:53 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8c4f774-2b77-4d46-b2d1-88f594a6f34c Nov 03 07:34:53 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:53 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd" returned: 0 in 0.459s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:34:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63eab12c-2a8b-4d2b-b0dc-25b6b1a71853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b09ab8-2d98-470f-bfda-dff5031f3587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:54 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Volume volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd (e2a02c98-702e-48bd-acdf-6d78deebc6dd): created successfully Nov 03 07:34:54 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b09ab8-2d98-470f-bfda-dff5031f3587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:54 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Flow 'volume_create_manager' (3f3a308a-2f43-438f-badd-1cf6c2babd75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:54 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-1ca35d91-3b64-4cb7-8f39-ed07631ac387 tempest-GroupSnapshotsTest-1286634275 None] Created volume successfully. Nov 03 07:34:54 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5be63b98-1d77-4498-8188-51d7e3a37521 tempest-TestInstancesWithCinderVolumes-719158012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8c4f774-2b77-4d46-b2d1-88f594a6f34c" returned: 0 in 0.631s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5be63b98-1d77-4498-8188-51d7e3a37521 tempest-TestInstancesWithCinderVolumes-719158012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8c4f774-2b77-4d46-b2d1-88f594a6f34c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:54 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8c4f774-2b77-4d46-b2d1-88f594a6f34c Nov 03 07:34:54 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:54 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5be63b98-1d77-4498-8188-51d7e3a37521 tempest-TestInstancesWithCinderVolumes-719158012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8c4f774-2b77-4d46-b2d1-88f594a6f34c" returned: 0 in 0.392s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:54 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5be63b98-1d77-4498-8188-51d7e3a37521 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "cinder-quobyte-d8c4f774-2b77-4d46-b2d1-88f594a6f34c" released by "delete_volume" :: held 1.108s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:54 devstack cinder-volume[87016]: WARNING cinder.quota [None req-5be63b98-1d77-4498-8188-51d7e3a37521 tempest-TestInstancesWithCinderVolumes-719158012 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2002514268-1827224612 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2002514268-1827224612, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:34:54 devstack cinder-volume[87016]: WARNING cinder.quota [None req-5be63b98-1d77-4498-8188-51d7e3a37521 tempest-TestInstancesWithCinderVolumes-719158012 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2002514268-1827224612 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2002514268-1827224612, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:34:54 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-5be63b98-1d77-4498-8188-51d7e3a37521 tempest-TestInstancesWithCinderVolumes-719158012 None] Created reservations ['8c8877e4-56a9-417a-841a-b4952ae5d52d', '229f05b6-7e2e-420c-9974-aa933d44359c', '583f0088-4c8f-4030-80b9-135da4f7c4fe', 'e32deff3-f1fa-4f94-b502-4c47e571cae6'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5be63b98-1d77-4498-8188-51d7e3a37521 tempest-TestInstancesWithCinderVolumes-719158012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5be63b98-1d77-4498-8188-51d7e3a37521 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5be63b98-1d77-4498-8188-51d7e3a37521 tempest-TestInstancesWithCinderVolumes-719158012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5be63b98-1d77-4498-8188-51d7e3a37521 tempest-TestInstancesWithCinderVolumes-719158012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5be63b98-1d77-4498-8188-51d7e3a37521 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5be63b98-1d77-4498-8188-51d7e3a37521 tempest-TestInstancesWithCinderVolumes-719158012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:54 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:34:54 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:55 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5be63b98-1d77-4498-8188-51d7e3a37521 tempest-TestInstancesWithCinderVolumes-719158012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.405s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:55 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-5be63b98-1d77-4498-8188-51d7e3a37521 tempest-TestInstancesWithCinderVolumes-719158012 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:55 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-5be63b98-1d77-4498-8188-51d7e3a37521 tempest-TestInstancesWithCinderVolumes-719158012 None] Deleted volume successfully. Nov 03 07:34:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5be63b98-1d77-4498-8188-51d7e3a37521 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "cinder-d8c4f774-2b77-4d46-b2d1-88f594a6f34c-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:55 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b32d967c-3a22-4e69-8a0f-07e4dc654039 tempest-GroupSnapshotsTest-1286634275 None] GroupSnapshot e9ea3f5a-513a-43f9-b9ad-5c40d136bdf1: creating. Nov 03 07:34:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b32d967c-3a22-4e69-8a0f-07e4dc654039 tempest-GroupSnapshotsTest-1286634275 None] Group snapshot e9ea3f5a-513a-43f9-b9ad-5c40d136bdf1: creating. {{(pid=87016) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 07:34:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b32d967c-3a22-4e69-8a0f-07e4dc654039 tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b32d967c-3a22-4e69-8a0f-07e4dc654039 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:55 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-b32d967c-3a22-4e69-8a0f-07e4dc654039 tempest-GroupSnapshotsTest-1286634275 None] Creating offline snapshot caffc26f-d6b3-40fd-8076-cd5a3ea3e935 of volume e2a02c98-702e-48bd-acdf-6d78deebc6dd {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:34:55 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee6bb01-4b22-40f5-9373-fedc710968f9]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b32d967c-3a22-4e69-8a0f-07e4dc654039 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:56 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd Nov 03 07:34:56 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:56 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b32d967c-3a22-4e69-8a0f-07e4dc654039 tempest-GroupSnapshotsTest-1286634275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd" returned: 0 in 0.559s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b32d967c-3a22-4e69-8a0f-07e4dc654039 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.caffc26f-d6b3-40fd-8076-cd5a3ea3e935 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:56 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.caffc26f-d6b3-40fd-8076-cd5a3ea3e935 1G Nov 03 07:34:56 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:57 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b32d967c-3a22-4e69-8a0f-07e4dc654039 tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.caffc26f-d6b3-40fd-8076-cd5a3ea3e935 1G" returned: 0 in 0.823s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b32d967c-3a22-4e69-8a0f-07e4dc654039 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.caffc26f-d6b3-40fd-8076-cd5a3ea3e935 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:57 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.caffc26f-d6b3-40fd-8076-cd5a3ea3e935 Nov 03 07:34:57 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:57 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b32d967c-3a22-4e69-8a0f-07e4dc654039 tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.caffc26f-d6b3-40fd-8076-cd5a3ea3e935" returned: 0 in 0.525s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:57 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-b32d967c-3a22-4e69-8a0f-07e4dc654039 tempest-GroupSnapshotsTest-1286634275 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.caffc26f-d6b3-40fd-8076-cd5a3ea3e935 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:34:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b32d967c-3a22-4e69-8a0f-07e4dc654039 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.caffc26f-d6b3-40fd-8076-cd5a3ea3e935 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:57 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.caffc26f-d6b3-40fd-8076-cd5a3ea3e935 Nov 03 07:34:57 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:58 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b32d967c-3a22-4e69-8a0f-07e4dc654039 tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.caffc26f-d6b3-40fd-8076-cd5a3ea3e935" returned: 0 in 0.436s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b32d967c-3a22-4e69-8a0f-07e4dc654039 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:58 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.info Nov 03 07:34:58 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:58 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b32d967c-3a22-4e69-8a0f-07e4dc654039 tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.info" returned: 0 in 0.498s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:58 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-b32d967c-3a22-4e69-8a0f-07e4dc654039 tempest-GroupSnapshotsTest-1286634275 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:34:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b32d967c-3a22-4e69-8a0f-07e4dc654039 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:58 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.info Nov 03 07:34:58 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:59 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-efa3200f-18b6-4c68-b2db-6f780ce4f343 req-ea939439-d95e-43de-a779-bc302c0eac8f tempest-TestInstancesWithCinderVolumes-719158012 None] Terminate volume connection completed successfully. Nov 03 07:34:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-efa3200f-18b6-4c68-b2db-6f780ce4f343 req-ea939439-d95e-43de-a779-bc302c0eac8f tempest-TestInstancesWithCinderVolumes-719158012 None] Deleting attachment 2e9e8772-d021-46af-bcb0-eac813219fb8. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:34:59 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b32d967c-3a22-4e69-8a0f-07e4dc654039 tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.info" returned: 0 in 0.443s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b32d967c-3a22-4e69-8a0f-07e4dc654039 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.481s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:59 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b32d967c-3a22-4e69-8a0f-07e4dc654039 tempest-GroupSnapshotsTest-1286634275 None] group_snapshot e9ea3f5a-513a-43f9-b9ad-5c40d136bdf1: created successfully Nov 03 07:34:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ef57e000-7119-4b19-b059-acb181746a62 tempest-TestInstancesWithCinderVolumes-719158012 None] Acquiring lock "cinder-9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ef57e000-7119-4b19-b059-acb181746a62 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "cinder-9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ef57e000-7119-4b19-b059-acb181746a62 tempest-TestInstancesWithCinderVolumes-719158012 None] Acquiring lock "cinder-quobyte-9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ef57e000-7119-4b19-b059-acb181746a62 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "cinder-quobyte-9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4" acquired by "delete_volume" :: waited 0.021s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:59 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c989fe-cef5-4c27-870a-cf34132822d8]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ef57e000-7119-4b19-b059-acb181746a62 tempest-TestInstancesWithCinderVolumes-719158012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:00 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4 Nov 03 07:35:00 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:00 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:00 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-938d120e-ea4a-4472-8933-d7b079e2e8e8 tempest-GroupSnapshotsTest-1286634275 None] group_snapshot e9ea3f5a-513a-43f9-b9ad-5c40d136bdf1: deleting Nov 03 07:35:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ef57e000-7119-4b19-b059-acb181746a62 tempest-TestInstancesWithCinderVolumes-719158012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4" returned: 0 in 0.650s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ef57e000-7119-4b19-b059-acb181746a62 tempest-TestInstancesWithCinderVolumes-719158012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:00 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-938d120e-ea4a-4472-8933-d7b079e2e8e8 tempest-GroupSnapshotsTest-1286634275 None] group_snapshot e9ea3f5a-513a-43f9-b9ad-5c40d136bdf1: deleting {{(pid=87016) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 07:35:00 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4 Nov 03 07:35:00 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-938d120e-ea4a-4472-8933-d7b079e2e8e8 tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "cinder-quobyte-e2a02c98-702e-48bd-acdf-6d78deebc6dd" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-938d120e-ea4a-4472-8933-d7b079e2e8e8 tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-e2a02c98-702e-48bd-acdf-6d78deebc6dd" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-938d120e-ea4a-4472-8933-d7b079e2e8e8 tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "cinder-quobyte-caffc26f-d6b3-40fd-8076-cd5a3ea3e935" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-938d120e-ea4a-4472-8933-d7b079e2e8e8 tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-caffc26f-d6b3-40fd-8076-cd5a3ea3e935" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-938d120e-ea4a-4472-8933-d7b079e2e8e8 tempest-GroupSnapshotsTest-1286634275 None] Deleting offline snapshot caffc26f-d6b3-40fd-8076-cd5a3ea3e935 of volume e2a02c98-702e-48bd-acdf-6d78deebc6dd {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:35:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-938d120e-ea4a-4472-8933-d7b079e2e8e8 tempest-GroupSnapshotsTest-1286634275 None] snapshot_file for this snap is: volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.caffc26f-d6b3-40fd-8076-cd5a3ea3e935 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:35:00 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf44ecba-95a3-4321-860c-397478faf329]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-938d120e-ea4a-4472-8933-d7b079e2e8e8 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.caffc26f-d6b3-40fd-8076-cd5a3ea3e935 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:01 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.caffc26f-d6b3-40fd-8076-cd5a3ea3e935 Nov 03 07:35:01 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:01 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ef57e000-7119-4b19-b059-acb181746a62 tempest-TestInstancesWithCinderVolumes-719158012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4" returned: 0 in 0.590s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ef57e000-7119-4b19-b059-acb181746a62 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "cinder-quobyte-9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4" released by "delete_volume" :: held 1.305s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:01 devstack cinder-volume[87016]: WARNING cinder.quota [None req-ef57e000-7119-4b19-b059-acb181746a62 tempest-TestInstancesWithCinderVolumes-719158012 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-254260791-431421056 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-254260791-431421056, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:35:01 devstack cinder-volume[87016]: WARNING cinder.quota [None req-ef57e000-7119-4b19-b059-acb181746a62 tempest-TestInstancesWithCinderVolumes-719158012 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-254260791-431421056 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-254260791-431421056, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:35:01 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-ef57e000-7119-4b19-b059-acb181746a62 tempest-TestInstancesWithCinderVolumes-719158012 None] Created reservations ['ee3a8a2e-d573-44e7-b44e-ef2291413289', '6bf01319-acb5-4118-97e9-c9e9228eab9a', '937bee12-2f4f-4a85-8253-1143f8faf219', '445a25af-44d0-4d49-871c-3f9bbe1be01d'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:35:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ef57e000-7119-4b19-b059-acb181746a62 tempest-TestInstancesWithCinderVolumes-719158012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ef57e000-7119-4b19-b059-acb181746a62 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:01 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ef57e000-7119-4b19-b059-acb181746a62 tempest-TestInstancesWithCinderVolumes-719158012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:01 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ef57e000-7119-4b19-b059-acb181746a62 tempest-TestInstancesWithCinderVolumes-719158012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ef57e000-7119-4b19-b059-acb181746a62 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ef57e000-7119-4b19-b059-acb181746a62 tempest-TestInstancesWithCinderVolumes-719158012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:01 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:35:01 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:01 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-938d120e-ea4a-4472-8933-d7b079e2e8e8 tempest-GroupSnapshotsTest-1286634275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.caffc26f-d6b3-40fd-8076-cd5a3ea3e935" returned: 0 in 0.893s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:01 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-938d120e-ea4a-4472-8933-d7b079e2e8e8 tempest-GroupSnapshotsTest-1286634275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:35:01 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c6419c-1395-4f5d-bf3b-0a64e35b08d4]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-938d120e-ea4a-4472-8933-d7b079e2e8e8 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:01 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd Nov 03 07:35:01 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:01 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ef57e000-7119-4b19-b059-acb181746a62 tempest-TestInstancesWithCinderVolumes-719158012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.492s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:01 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-ef57e000-7119-4b19-b059-acb181746a62 tempest-TestInstancesWithCinderVolumes-719158012 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:35:01 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ef57e000-7119-4b19-b059-acb181746a62 tempest-TestInstancesWithCinderVolumes-719158012 None] Deleted volume successfully. Nov 03 07:35:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ef57e000-7119-4b19-b059-acb181746a62 tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "cinder-9519bbf5-5ddb-4bf9-b1f3-04e6d736c0a4-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:02 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-938d120e-ea4a-4472-8933-d7b079e2e8e8 tempest-GroupSnapshotsTest-1286634275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd" returned: 0 in 0.692s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-938d120e-ea4a-4472-8933-d7b079e2e8e8 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.caffc26f-d6b3-40fd-8076-cd5a3ea3e935 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:02 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.caffc26f-d6b3-40fd-8076-cd5a3ea3e935 Nov 03 07:35:02 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:02 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-938d120e-ea4a-4472-8933-d7b079e2e8e8 tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.caffc26f-d6b3-40fd-8076-cd5a3ea3e935" returned: 0 in 0.530s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-938d120e-ea4a-4472-8933-d7b079e2e8e8 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.caffc26f-d6b3-40fd-8076-cd5a3ea3e935 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:02 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.caffc26f-d6b3-40fd-8076-cd5a3ea3e935 Nov 03 07:35:02 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:03 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-938d120e-ea4a-4472-8933-d7b079e2e8e8 tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd.caffc26f-d6b3-40fd-8076-cd5a3ea3e935" returned: 0 in 0.457s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-938d120e-ea4a-4472-8933-d7b079e2e8e8 tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-caffc26f-d6b3-40fd-8076-cd5a3ea3e935" released by "_delete_snapshot" :: held 2.759s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-938d120e-ea4a-4472-8933-d7b079e2e8e8 tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-e2a02c98-702e-48bd-acdf-6d78deebc6dd" released by "delete_snapshot" :: held 2.801s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:03 devstack cinder-volume[87016]: WARNING cinder.quota [None req-938d120e-ea4a-4472-8933-d7b079e2e8e8 tempest-GroupSnapshotsTest-1286634275 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1627322820 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1627322820, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:35:03 devstack cinder-volume[87016]: WARNING cinder.quota [None req-938d120e-ea4a-4472-8933-d7b079e2e8e8 tempest-GroupSnapshotsTest-1286634275 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1627322820 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1627322820, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:35:03 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-938d120e-ea4a-4472-8933-d7b079e2e8e8 tempest-GroupSnapshotsTest-1286634275 None] Created reservations ['dea1b07e-a461-4f7c-8212-66204267726c', '661a63a8-2b73-40b9-8ed5-50c373e3141a', '20ed0f0c-9fdf-4d45-b25e-7ff5f62d6ee8', '0f0d484e-cdca-4140-a9fb-26d135977162'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:35:03 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-938d120e-ea4a-4472-8933-d7b079e2e8e8 tempest-GroupSnapshotsTest-1286634275 None] group_snapshot e9ea3f5a-513a-43f9-b9ad-5c40d136bdf1: deleted successfully Nov 03 07:35:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-93e52737-2848-4f33-80d5-9542d08a5071 tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "cinder-quobyte-e2a02c98-702e-48bd-acdf-6d78deebc6dd" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-93e52737-2848-4f33-80d5-9542d08a5071 tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-e2a02c98-702e-48bd-acdf-6d78deebc6dd" acquired by "delete_volume" :: waited 0.039s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:05 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5037157-b581-40e3-b5d6-0bc440126c3b]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-93e52737-2848-4f33-80d5-9542d08a5071 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:05 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd Nov 03 07:35:05 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:05 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-93e52737-2848-4f33-80d5-9542d08a5071 tempest-GroupSnapshotsTest-1286634275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd" returned: 0 in 0.743s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-93e52737-2848-4f33-80d5-9542d08a5071 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:05 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd Nov 03 07:35:05 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:06 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-93e52737-2848-4f33-80d5-9542d08a5071 tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e2a02c98-702e-48bd-acdf-6d78deebc6dd" returned: 0 in 0.525s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:06 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-93e52737-2848-4f33-80d5-9542d08a5071 tempest-GroupSnapshotsTest-1286634275 None] Lock "cinder-quobyte-e2a02c98-702e-48bd-acdf-6d78deebc6dd" released by "delete_volume" :: held 1.460s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:06 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-93e52737-2848-4f33-80d5-9542d08a5071 tempest-GroupSnapshotsTest-1286634275 None] Created reservations ['91547c95-fa4a-4735-ba5d-33b6945669e4'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:35:06 devstack cinder-volume[87016]: WARNING cinder.quota [None req-93e52737-2848-4f33-80d5-9542d08a5071 tempest-GroupSnapshotsTest-1286634275 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1627322820 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1627322820, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:35:06 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-93e52737-2848-4f33-80d5-9542d08a5071 tempest-GroupSnapshotsTest-1286634275 None] Created reservations ['f26acbcc-6f56-4db2-aabc-d75f19c6d755', 'e71499b0-8001-4456-8874-4685605e37d8', 'f6f2e980-8026-4746-862e-7a1099c918d8', '91433c0f-c6cc-45db-8e55-c9340d3704a4'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:35:06 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-035d4c35-ae02-40d8-b8c1-218abca4cfaf req-775ec562-913d-4da9-8524-6204db6c826d tempest-TestInstancesWithCinderVolumes-719158012 None] Terminate volume connection completed successfully. Nov 03 07:35:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-035d4c35-ae02-40d8-b8c1-218abca4cfaf req-775ec562-913d-4da9-8524-6204db6c826d tempest-TestInstancesWithCinderVolumes-719158012 None] Deleting attachment 003e5679-56d6-4df5-88b3-81d91fc0447d. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:35:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-93e52737-2848-4f33-80d5-9542d08a5071 tempest-GroupSnapshotsTest-1286634275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-93e52737-2848-4f33-80d5-9542d08a5071 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:06 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-93e52737-2848-4f33-80d5-9542d08a5071 tempest-GroupSnapshotsTest-1286634275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:06 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-93e52737-2848-4f33-80d5-9542d08a5071 tempest-GroupSnapshotsTest-1286634275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-93e52737-2848-4f33-80d5-9542d08a5071 tempest-GroupSnapshotsTest-1286634275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-93e52737-2848-4f33-80d5-9542d08a5071 tempest-GroupSnapshotsTest-1286634275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:06 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:35:06 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:07 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-93e52737-2848-4f33-80d5-9542d08a5071 tempest-GroupSnapshotsTest-1286634275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.387s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-93e52737-2848-4f33-80d5-9542d08a5071 tempest-GroupSnapshotsTest-1286634275 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:35:07 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-93e52737-2848-4f33-80d5-9542d08a5071 tempest-GroupSnapshotsTest-1286634275 None] Delete group completed successfully. Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Flow 'volume_create_manager' (a1ca45cc-415d-4513-abae-886862729519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca7cbed-32a2-444f-9638-fa82b7985113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca7cbed-32a2-444f-9638-fa82b7985113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-408919435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f9be4d0-2a55-49d4-b633-a7f4f80caad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ddea081a978456a8e0a6e2ce1f7d0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:07Z,use_quota=True,user_id='d785a1c6cb09432a856249a85f706f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4c8621-2f63-441b-b7c1-09bfe3de6039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4c8621-2f63-441b-b7c1-09bfe3de6039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85d0230-2e26-4dda-be27-286bc6770dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85d0230-2e26-4dda-be27-286bc6770dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f9be4d0-2a55-49d4-b633-a7f4f80caad9', 'volume_name': 'volume-0f9be4d0-2a55-49d4-b633-a7f4f80caad9', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13caeb42-420d-47bb-8c55-849909362c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13caeb42-420d-47bb-8c55-849909362c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff9db98-8e5c-4f1a-8a72-f37d5e181420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:07 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Volume 0f9be4d0-2a55-49d4-b633-a7f4f80caad9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f9be4d0-2a55-49d4-b633-a7f4f80caad9', 'volume_size': 1} Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-408919435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f9be4d0-2a55-49d4-b633-a7f4f80caad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ddea081a978456a8e0a6e2ce1f7d0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:07Z,use_quota=True,user_id='d785a1c6cb09432a856249a85f706f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Creating volume 0f9be4d0-2a55-49d4-b633-a7f4f80caad9 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:35:07 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:35:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f9be4d0-2a55-49d4-b633-a7f4f80caad9 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:07 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f9be4d0-2a55-49d4-b633-a7f4f80caad9 1073741824 Nov 03 07:35:07 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:08 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f9be4d0-2a55-49d4-b633-a7f4f80caad9 1073741824" returned: 0 in 0.825s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f9be4d0-2a55-49d4-b633-a7f4f80caad9 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:08 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f9be4d0-2a55-49d4-b633-a7f4f80caad9 Nov 03 07:35:08 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:08 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f9be4d0-2a55-49d4-b633-a7f4f80caad9" returned: 0 in 0.340s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:35:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff9db98-8e5c-4f1a-8a72-f37d5e181420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f9be4d0-2a55-49d4-b633-a7f4f80caad9', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d60baeef-aad0-4ef6-83ae-230dfb17d2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:08 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Volume volume-0f9be4d0-2a55-49d4-b633-a7f4f80caad9 (0f9be4d0-2a55-49d4-b633-a7f4f80caad9): created successfully Nov 03 07:35:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d60baeef-aad0-4ef6-83ae-230dfb17d2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Flow 'volume_create_manager' (a1ca45cc-415d-4513-abae-886862729519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:09 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-67e5c359-7765-4d44-94ce-7021ff9dbc86 tempest-VolumesTransfersV355Test-819445837 None] Created volume successfully. Nov 03 07:35:09 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ab0e3ac1-9b4a-47d6-b098-29dc8f3a016a tempest-TestInstancesWithCinderVolumes-719158012 None] Acquiring lock "cinder-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:09 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ab0e3ac1-9b4a-47d6-b098-29dc8f3a016a tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "cinder-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:09 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ab0e3ac1-9b4a-47d6-b098-29dc8f3a016a tempest-TestInstancesWithCinderVolumes-719158012 None] Acquiring lock "cinder-quobyte-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:09 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ab0e3ac1-9b4a-47d6-b098-29dc8f3a016a tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "cinder-quobyte-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f" acquired by "delete_volume" :: waited 0.019s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:09 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1c045f-98e0-4724-9edb-7b54be125267]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ab0e3ac1-9b4a-47d6-b098-29dc8f3a016a tempest-TestInstancesWithCinderVolumes-719158012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:09 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f Nov 03 07:35:09 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:09 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ab0e3ac1-9b4a-47d6-b098-29dc8f3a016a tempest-TestInstancesWithCinderVolumes-719158012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f" returned: 0 in 0.620s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ab0e3ac1-9b4a-47d6-b098-29dc8f3a016a tempest-TestInstancesWithCinderVolumes-719158012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:09 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f Nov 03 07:35:09 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:10 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ab0e3ac1-9b4a-47d6-b098-29dc8f3a016a tempest-TestInstancesWithCinderVolumes-719158012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f" returned: 0 in 0.438s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:10 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ab0e3ac1-9b4a-47d6-b098-29dc8f3a016a tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "cinder-quobyte-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f" released by "delete_volume" :: held 1.125s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:10 devstack cinder-volume[87016]: WARNING cinder.quota [None req-ab0e3ac1-9b4a-47d6-b098-29dc8f3a016a tempest-TestInstancesWithCinderVolumes-719158012 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-671784131-2554093 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-671784131-2554093, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:35:10 devstack cinder-volume[87016]: WARNING cinder.quota [None req-ab0e3ac1-9b4a-47d6-b098-29dc8f3a016a tempest-TestInstancesWithCinderVolumes-719158012 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-671784131-2554093 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-671784131-2554093, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:35:10 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-ab0e3ac1-9b4a-47d6-b098-29dc8f3a016a tempest-TestInstancesWithCinderVolumes-719158012 None] Created reservations ['1cd372c2-5e89-488c-bef2-62aa02352f4d', '85d1be05-c70d-4961-a5a9-e3a88171d945', '3c50b2df-0de0-4169-a429-4e67af4a1940', 'b13cdafa-9794-4c82-a8fa-d818a986026f'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:35:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ab0e3ac1-9b4a-47d6-b098-29dc8f3a016a tempest-TestInstancesWithCinderVolumes-719158012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ab0e3ac1-9b4a-47d6-b098-29dc8f3a016a tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ab0e3ac1-9b4a-47d6-b098-29dc8f3a016a tempest-TestInstancesWithCinderVolumes-719158012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ab0e3ac1-9b4a-47d6-b098-29dc8f3a016a tempest-TestInstancesWithCinderVolumes-719158012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ab0e3ac1-9b4a-47d6-b098-29dc8f3a016a tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ab0e3ac1-9b4a-47d6-b098-29dc8f3a016a tempest-TestInstancesWithCinderVolumes-719158012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:10 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:35:10 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:10 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-37f613d1-cdef-4cf7-8ba8-2b148cdd69b8 tempest-VolumesTransfersV355Test-1418224842 None] Transfer volume completed successfully. Nov 03 07:35:11 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ab0e3ac1-9b4a-47d6-b098-29dc8f3a016a tempest-TestInstancesWithCinderVolumes-719158012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.457s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:11 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-ab0e3ac1-9b4a-47d6-b098-29dc8f3a016a tempest-TestInstancesWithCinderVolumes-719158012 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:35:11 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ab0e3ac1-9b4a-47d6-b098-29dc8f3a016a tempest-TestInstancesWithCinderVolumes-719158012 None] Deleted volume successfully. Nov 03 07:35:11 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ab0e3ac1-9b4a-47d6-b098-29dc8f3a016a tempest-TestInstancesWithCinderVolumes-719158012 None] Lock "cinder-37a60b1c-59d2-4dce-b3e3-7d60b26afa7f-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2c260106-b2c3-4e45-9384-6eeccbeeab45 tempest-VolumesTransfersV355Test-808623557 None] Acquiring lock "cinder-0f9be4d0-2a55-49d4-b633-a7f4f80caad9-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2c260106-b2c3-4e45-9384-6eeccbeeab45 tempest-VolumesTransfersV355Test-808623557 None] Lock "cinder-0f9be4d0-2a55-49d4-b633-a7f4f80caad9-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2c260106-b2c3-4e45-9384-6eeccbeeab45 tempest-VolumesTransfersV355Test-808623557 None] Acquiring lock "cinder-quobyte-0f9be4d0-2a55-49d4-b633-a7f4f80caad9" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2c260106-b2c3-4e45-9384-6eeccbeeab45 tempest-VolumesTransfersV355Test-808623557 None] Lock "cinder-quobyte-0f9be4d0-2a55-49d4-b633-a7f4f80caad9" acquired by "delete_volume" :: waited 0.023s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:12 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c68beb-b794-4f55-8750-5e3b9b175d6f]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2c260106-b2c3-4e45-9384-6eeccbeeab45 tempest-VolumesTransfersV355Test-808623557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f9be4d0-2a55-49d4-b633-a7f4f80caad9 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:12 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f9be4d0-2a55-49d4-b633-a7f4f80caad9 Nov 03 07:35:12 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:12 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2c260106-b2c3-4e45-9384-6eeccbeeab45 tempest-VolumesTransfersV355Test-808623557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f9be4d0-2a55-49d4-b633-a7f4f80caad9" returned: 0 in 0.618s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2c260106-b2c3-4e45-9384-6eeccbeeab45 tempest-VolumesTransfersV355Test-808623557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f9be4d0-2a55-49d4-b633-a7f4f80caad9 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:12 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f9be4d0-2a55-49d4-b633-a7f4f80caad9 Nov 03 07:35:12 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:13 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2c260106-b2c3-4e45-9384-6eeccbeeab45 tempest-VolumesTransfersV355Test-808623557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f9be4d0-2a55-49d4-b633-a7f4f80caad9" returned: 0 in 0.331s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2c260106-b2c3-4e45-9384-6eeccbeeab45 tempest-VolumesTransfersV355Test-808623557 None] Lock "cinder-quobyte-0f9be4d0-2a55-49d4-b633-a7f4f80caad9" released by "delete_volume" :: held 1.023s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:13 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-2c260106-b2c3-4e45-9384-6eeccbeeab45 tempest-VolumesTransfersV355Test-808623557 None] Created reservations ['1d650108-6231-4fbe-b5b8-73c5f2b1d56c', 'c31019eb-748d-401f-a752-f226bbdfbe0d', '5080fcc4-e1f1-4a2b-9e87-28cec3679197', '03df2c2e-5f47-4b5c-ac89-547bde796876'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:35:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2c260106-b2c3-4e45-9384-6eeccbeeab45 tempest-VolumesTransfersV355Test-808623557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2c260106-b2c3-4e45-9384-6eeccbeeab45 tempest-VolumesTransfersV355Test-808623557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2c260106-b2c3-4e45-9384-6eeccbeeab45 tempest-VolumesTransfersV355Test-808623557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2c260106-b2c3-4e45-9384-6eeccbeeab45 tempest-VolumesTransfersV355Test-808623557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2c260106-b2c3-4e45-9384-6eeccbeeab45 tempest-VolumesTransfersV355Test-808623557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2c260106-b2c3-4e45-9384-6eeccbeeab45 tempest-VolumesTransfersV355Test-808623557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:13 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:35:13 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:13 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2c260106-b2c3-4e45-9384-6eeccbeeab45 tempest-VolumesTransfersV355Test-808623557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.493s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:13 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-2c260106-b2c3-4e45-9384-6eeccbeeab45 tempest-VolumesTransfersV355Test-808623557 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:35:13 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-2c260106-b2c3-4e45-9384-6eeccbeeab45 tempest-VolumesTransfersV355Test-808623557 None] Deleted volume successfully. Nov 03 07:35:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2c260106-b2c3-4e45-9384-6eeccbeeab45 tempest-VolumesTransfersV355Test-808623557 None] Lock "cinder-0f9be4d0-2a55-49d4-b633-a7f4f80caad9-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:15 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:35:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Flow 'volume_create_manager' (e65be921-520e-41f4-8529-51af9a198b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f616b7-4375-4037-b85e-8963e4b58ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f616b7-4375-4037-b85e-8963e4b58ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-76127044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e57182-ae85-4c97-95e8-55313bb8ad78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ddea081a978456a8e0a6e2ce1f7d0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:15Z,use_quota=True,user_id='d785a1c6cb09432a856249a85f706f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c338c3-4413-48f1-810e-fa49e6f58364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c338c3-4413-48f1-810e-fa49e6f58364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5729528-ae72-4923-b5e5-ec43d2e201fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5729528-ae72-4923-b5e5-ec43d2e201fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65e57182-ae85-4c97-95e8-55313bb8ad78', 'volume_name': 'volume-65e57182-ae85-4c97-95e8-55313bb8ad78', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71bf357e-f56c-4002-bf34-562c779a453f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71bf357e-f56c-4002-bf34-562c779a453f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c5a23a-5d97-4e06-8ca7-4a9e3b3122f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:15 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Volume 65e57182-ae85-4c97-95e8-55313bb8ad78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65e57182-ae85-4c97-95e8-55313bb8ad78', 'volume_size': 1} Nov 03 07:35:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-76127044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e57182-ae85-4c97-95e8-55313bb8ad78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ddea081a978456a8e0a6e2ce1f7d0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:15Z,use_quota=True,user_id='d785a1c6cb09432a856249a85f706f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:35:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Creating volume 65e57182-ae85-4c97-95e8-55313bb8ad78 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:35:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:35:15 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:35:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65e57182-ae85-4c97-95e8-55313bb8ad78 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:15 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65e57182-ae85-4c97-95e8-55313bb8ad78 1073741824 Nov 03 07:35:15 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:16 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65e57182-ae85-4c97-95e8-55313bb8ad78 1073741824" returned: 0 in 0.609s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65e57182-ae85-4c97-95e8-55313bb8ad78 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:16 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65e57182-ae85-4c97-95e8-55313bb8ad78 Nov 03 07:35:16 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:16 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65e57182-ae85-4c97-95e8-55313bb8ad78" returned: 0 in 0.405s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:35:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:16 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c5a23a-5d97-4e06-8ca7-4a9e3b3122f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65e57182-ae85-4c97-95e8-55313bb8ad78', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:16 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc5d880-1e3a-4708-8920-9a195fdb27e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:16 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Volume volume-65e57182-ae85-4c97-95e8-55313bb8ad78 (65e57182-ae85-4c97-95e8-55313bb8ad78): created successfully Nov 03 07:35:16 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc5d880-1e3a-4708-8920-9a195fdb27e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:16 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Flow 'volume_create_manager' (e65be921-520e-41f4-8529-51af9a198b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:16 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-5061af67-8228-4ca4-a28a-e937228da7e4 tempest-VolumesTransfersV355Test-819445837 None] Created volume successfully. Nov 03 07:35:17 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-fedc293a-9e2f-43d3-90ca-5c1c6a56405e tempest-GroupsTest-1573866207 None] Group tempest-Group1-1703878011: creating Nov 03 07:35:17 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-fedc293a-9e2f-43d3-90ca-5c1c6a56405e tempest-GroupsTest-1573866207 None] Group tempest-Group1-1703878011: created successfully Nov 03 07:35:17 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-fedc293a-9e2f-43d3-90ca-5c1c6a56405e tempest-GroupsTest-1573866207 None] Create group completed successfully. Nov 03 07:35:18 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ba8ab2dc-95b5-4bc5-979c-6dc2953df2f8 tempest-VolumesTransfersV355Test-808623557 None] Acquiring lock "cinder-65e57182-ae85-4c97-95e8-55313bb8ad78-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:18 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ba8ab2dc-95b5-4bc5-979c-6dc2953df2f8 tempest-VolumesTransfersV355Test-808623557 None] Lock "cinder-65e57182-ae85-4c97-95e8-55313bb8ad78-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:18 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ba8ab2dc-95b5-4bc5-979c-6dc2953df2f8 tempest-VolumesTransfersV355Test-808623557 None] Acquiring lock "cinder-quobyte-65e57182-ae85-4c97-95e8-55313bb8ad78" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:18 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ba8ab2dc-95b5-4bc5-979c-6dc2953df2f8 tempest-VolumesTransfersV355Test-808623557 None] Lock "cinder-quobyte-65e57182-ae85-4c97-95e8-55313bb8ad78" acquired by "delete_volume" :: waited 0.024s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:18 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[398223ce-ed1b-4cd4-8ded-25f9719bdf75]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ba8ab2dc-95b5-4bc5-979c-6dc2953df2f8 tempest-VolumesTransfersV355Test-808623557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65e57182-ae85-4c97-95e8-55313bb8ad78 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:18 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65e57182-ae85-4c97-95e8-55313bb8ad78 Nov 03 07:35:18 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:18 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ba8ab2dc-95b5-4bc5-979c-6dc2953df2f8 tempest-VolumesTransfersV355Test-808623557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65e57182-ae85-4c97-95e8-55313bb8ad78" returned: 0 in 0.446s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ba8ab2dc-95b5-4bc5-979c-6dc2953df2f8 tempest-VolumesTransfersV355Test-808623557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65e57182-ae85-4c97-95e8-55313bb8ad78 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:18 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65e57182-ae85-4c97-95e8-55313bb8ad78 Nov 03 07:35:18 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:19 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-24d12407-8066-4f11-8769-185776e4c845 tempest-GroupsTest-1573866207 None] Group tempest-Group2-1403934444: creating Nov 03 07:35:19 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ba8ab2dc-95b5-4bc5-979c-6dc2953df2f8 tempest-VolumesTransfersV355Test-808623557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-65e57182-ae85-4c97-95e8-55313bb8ad78" returned: 0 in 0.421s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ba8ab2dc-95b5-4bc5-979c-6dc2953df2f8 tempest-VolumesTransfersV355Test-808623557 None] Lock "cinder-quobyte-65e57182-ae85-4c97-95e8-55313bb8ad78" released by "delete_volume" :: held 0.927s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:19 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-24d12407-8066-4f11-8769-185776e4c845 tempest-GroupsTest-1573866207 None] Group tempest-Group2-1403934444: created successfully Nov 03 07:35:19 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-24d12407-8066-4f11-8769-185776e4c845 tempest-GroupsTest-1573866207 None] Create group completed successfully. Nov 03 07:35:19 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-ba8ab2dc-95b5-4bc5-979c-6dc2953df2f8 tempest-VolumesTransfersV355Test-808623557 None] Created reservations ['955e7b55-41da-4d21-94ff-eb04fbb66e5f', 'cd0cf85c-baac-4334-b6d3-999b3d7f4018', '1c8baf8f-c715-45fc-92cc-81c5b20dd27d', '64e8d6af-cc2d-4645-b513-bcb5c49026d3'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:35:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ba8ab2dc-95b5-4bc5-979c-6dc2953df2f8 tempest-VolumesTransfersV355Test-808623557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ba8ab2dc-95b5-4bc5-979c-6dc2953df2f8 tempest-VolumesTransfersV355Test-808623557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ba8ab2dc-95b5-4bc5-979c-6dc2953df2f8 tempest-VolumesTransfersV355Test-808623557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ba8ab2dc-95b5-4bc5-979c-6dc2953df2f8 tempest-VolumesTransfersV355Test-808623557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ba8ab2dc-95b5-4bc5-979c-6dc2953df2f8 tempest-VolumesTransfersV355Test-808623557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ba8ab2dc-95b5-4bc5-979c-6dc2953df2f8 tempest-VolumesTransfersV355Test-808623557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:19 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:35:19 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:19 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ba8ab2dc-95b5-4bc5-979c-6dc2953df2f8 tempest-VolumesTransfersV355Test-808623557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.345s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:19 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-ba8ab2dc-95b5-4bc5-979c-6dc2953df2f8 tempest-VolumesTransfersV355Test-808623557 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:35:19 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ba8ab2dc-95b5-4bc5-979c-6dc2953df2f8 tempest-VolumesTransfersV355Test-808623557 None] Deleted volume successfully. Nov 03 07:35:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ba8ab2dc-95b5-4bc5-979c-6dc2953df2f8 tempest-VolumesTransfersV355Test-808623557 None] Lock "cinder-65e57182-ae85-4c97-95e8-55313bb8ad78-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:21 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:35:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Flow 'volume_create_manager' (80260c45-2106-47d5-87b9-f8e6aead668d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42a75ed-9b2a-45a6-9e9f-b080bb44958b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42a75ed-9b2a-45a6-9e9f-b080bb44958b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1161625000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8f5ff9d2-a19f-4858-bf5c-84969699769f,host='devstack@QuobyteHD#QuobyteHD',id=c28e8583-5229-4097-85dc-63aeebf8bf8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec00fdc919c44a829367c4a18461c67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:21Z,use_quota=True,user_id='ebafe56c6d824d3fb3fac45267fb9b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2dc8cf70-e34f-474d-9c62-4a8de20f6b46),volume_type_id=2dc8cf70-e34f-474d-9c62-4a8de20f6b46)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc621bb7-0823-45e5-a842-05c1c9586336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc621bb7-0823-45e5-a842-05c1c9586336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007a62c3-bd2c-4486-a0ec-a8bf2ff49134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007a62c3-bd2c-4486-a0ec-a8bf2ff49134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c28e8583-5229-4097-85dc-63aeebf8bf8a', 'volume_name': 'volume-c28e8583-5229-4097-85dc-63aeebf8bf8a', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a6e3b9a-16d0-418d-b33e-6341fb651974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a6e3b9a-16d0-418d-b33e-6341fb651974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ca7402-d4fe-4c2c-be59-616f44270237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:21 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Volume c28e8583-5229-4097-85dc-63aeebf8bf8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c28e8583-5229-4097-85dc-63aeebf8bf8a', 'volume_size': 1} Nov 03 07:35:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8f5ff9d2-a19f-4858-bf5c-84969699769f,created_at=2026-11-03T06:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1161625000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8f5ff9d2-a19f-4858-bf5c-84969699769f,host='devstack@QuobyteHD#QuobyteHD',id=c28e8583-5229-4097-85dc-63aeebf8bf8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec00fdc919c44a829367c4a18461c67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:21Z,use_quota=True,user_id='ebafe56c6d824d3fb3fac45267fb9b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2dc8cf70-e34f-474d-9c62-4a8de20f6b46),volume_type_id=2dc8cf70-e34f-474d-9c62-4a8de20f6b46)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:35:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Creating volume c28e8583-5229-4097-85dc-63aeebf8bf8a {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:35:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:35:21 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:35:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c28e8583-5229-4097-85dc-63aeebf8bf8a 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:21 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c28e8583-5229-4097-85dc-63aeebf8bf8a 1073741824 Nov 03 07:35:21 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:22 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c28e8583-5229-4097-85dc-63aeebf8bf8a 1073741824" returned: 0 in 0.684s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c28e8583-5229-4097-85dc-63aeebf8bf8a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:22 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c28e8583-5229-4097-85dc-63aeebf8bf8a Nov 03 07:35:22 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:22 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c28e8583-5229-4097-85dc-63aeebf8bf8a" returned: 0 in 0.363s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:22 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:35:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ca7402-d4fe-4c2c-be59-616f44270237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c28e8583-5229-4097-85dc-63aeebf8bf8a', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b9f432-7c9d-4503-9561-df238fee5f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:22 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Volume volume-c28e8583-5229-4097-85dc-63aeebf8bf8a (c28e8583-5229-4097-85dc-63aeebf8bf8a): created successfully Nov 03 07:35:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b9f432-7c9d-4503-9561-df238fee5f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Flow 'volume_create_manager' (80260c45-2106-47d5-87b9-f8e6aead668d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:22 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-95977741-1f7d-4e9f-996f-913d75d2fe19 tempest-GroupsTest-1573866207 None] Created volume successfully. Nov 03 07:35:25 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2c7ee7de-1f68-4d60-bd12-88c85d915a07 tempest-GroupsTest-1573866207 None] Acquiring lock "cinder-quobyte-c28e8583-5229-4097-85dc-63aeebf8bf8a" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:25 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2c7ee7de-1f68-4d60-bd12-88c85d915a07 tempest-GroupsTest-1573866207 None] Lock "cinder-quobyte-c28e8583-5229-4097-85dc-63aeebf8bf8a" acquired by "delete_volume" :: waited 0.015s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:25 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a42b0c6-fc28-46cc-ae2b-54db9250aff3]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2c7ee7de-1f68-4d60-bd12-88c85d915a07 tempest-GroupsTest-1573866207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c28e8583-5229-4097-85dc-63aeebf8bf8a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:25 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c28e8583-5229-4097-85dc-63aeebf8bf8a Nov 03 07:35:25 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:25 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2c7ee7de-1f68-4d60-bd12-88c85d915a07 tempest-GroupsTest-1573866207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c28e8583-5229-4097-85dc-63aeebf8bf8a" returned: 0 in 0.453s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2c7ee7de-1f68-4d60-bd12-88c85d915a07 tempest-GroupsTest-1573866207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c28e8583-5229-4097-85dc-63aeebf8bf8a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:25 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c28e8583-5229-4097-85dc-63aeebf8bf8a Nov 03 07:35:25 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:25 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2c7ee7de-1f68-4d60-bd12-88c85d915a07 tempest-GroupsTest-1573866207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c28e8583-5229-4097-85dc-63aeebf8bf8a" returned: 0 in 0.271s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:25 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2c7ee7de-1f68-4d60-bd12-88c85d915a07 tempest-GroupsTest-1573866207 None] Lock "cinder-quobyte-c28e8583-5229-4097-85dc-63aeebf8bf8a" released by "delete_volume" :: held 0.799s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:25 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-2c7ee7de-1f68-4d60-bd12-88c85d915a07 tempest-GroupsTest-1573866207 None] Created reservations ['dceb364b-205b-4324-844f-5a6333447ed8'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:35:25 devstack cinder-volume[87016]: WARNING cinder.quota [None req-2c7ee7de-1f68-4d60-bd12-88c85d915a07 tempest-GroupsTest-1573866207 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-492835734 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-492835734, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:35:25 devstack cinder-volume[87016]: WARNING cinder.quota [None req-2c7ee7de-1f68-4d60-bd12-88c85d915a07 tempest-GroupsTest-1573866207 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-492835734 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-492835734, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:35:25 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-2c7ee7de-1f68-4d60-bd12-88c85d915a07 tempest-GroupsTest-1573866207 None] Created reservations ['618fb87f-b9ec-4921-98d6-42e23a06d457', '4f8ba95c-9242-4f32-98d4-4f5ecbcff177', 'a7e550e4-9cc8-4825-97ee-b6bc4df1c005', '3600a538-92be-4900-864d-ef8d905cf0bc'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:35:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2c7ee7de-1f68-4d60-bd12-88c85d915a07 tempest-GroupsTest-1573866207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2c7ee7de-1f68-4d60-bd12-88c85d915a07 tempest-GroupsTest-1573866207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2c7ee7de-1f68-4d60-bd12-88c85d915a07 tempest-GroupsTest-1573866207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2c7ee7de-1f68-4d60-bd12-88c85d915a07 tempest-GroupsTest-1573866207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2c7ee7de-1f68-4d60-bd12-88c85d915a07 tempest-GroupsTest-1573866207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2c7ee7de-1f68-4d60-bd12-88c85d915a07 tempest-GroupsTest-1573866207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:26 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:35:26 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:26 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2c7ee7de-1f68-4d60-bd12-88c85d915a07 tempest-GroupsTest-1573866207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.449s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:26 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-2c7ee7de-1f68-4d60-bd12-88c85d915a07 tempest-GroupsTest-1573866207 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:35:26 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-2c7ee7de-1f68-4d60-bd12-88c85d915a07 tempest-GroupsTest-1573866207 None] Delete group completed successfully. Nov 03 07:35:26 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-7eeeb486-d2a2-4f74-9928-1b851e41d89f tempest-GroupsTest-1573866207 None] Created reservations ['730eac73-1c50-473c-a9bc-01b0f9197247'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:35:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7eeeb486-d2a2-4f74-9928-1b851e41d89f tempest-GroupsTest-1573866207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7eeeb486-d2a2-4f74-9928-1b851e41d89f tempest-GroupsTest-1573866207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7eeeb486-d2a2-4f74-9928-1b851e41d89f tempest-GroupsTest-1573866207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7eeeb486-d2a2-4f74-9928-1b851e41d89f tempest-GroupsTest-1573866207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7eeeb486-d2a2-4f74-9928-1b851e41d89f tempest-GroupsTest-1573866207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7eeeb486-d2a2-4f74-9928-1b851e41d89f tempest-GroupsTest-1573866207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:26 devstack sudo[99523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:35:26 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:27 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7eeeb486-d2a2-4f74-9928-1b851e41d89f tempest-GroupsTest-1573866207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.328s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:27 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-7eeeb486-d2a2-4f74-9928-1b851e41d89f tempest-GroupsTest-1573866207 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:35:27 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-7eeeb486-d2a2-4f74-9928-1b851e41d89f tempest-GroupsTest-1573866207 None] Delete group completed successfully. Nov 03 07:35:28 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-4cd42388-73ba-4596-84f9-050bc5b17963 tempest-GroupsTest-1573866207 None] Group tempest-GroupsTest-Group-115437208: creating Nov 03 07:35:28 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-4cd42388-73ba-4596-84f9-050bc5b17963 tempest-GroupsTest-1573866207 None] Group tempest-GroupsTest-Group-115437208: created successfully Nov 03 07:35:28 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-4cd42388-73ba-4596-84f9-050bc5b17963 tempest-GroupsTest-1573866207 None] Create group completed successfully. Nov 03 07:35:30 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:35:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Flow 'volume_create_manager' (5950b603-820f-4931-af93-880971abd863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3412aef2-42b4-4860-adbe-4e44eb6014f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3412aef2-42b4-4860-adbe-4e44eb6014f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2136258840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=909c561f-e134-41d5-808d-c6a6a3fe6c90,host='devstack@QuobyteHD#QuobyteHD',id=70910014-74c8-4c41-8bf2-da2e2e999e9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec00fdc919c44a829367c4a18461c67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:30Z,use_quota=True,user_id='ebafe56c6d824d3fb3fac45267fb9b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3feb7806-200a-470e-88ee-7f75af78bbc8),volume_type_id=3feb7806-200a-470e-88ee-7f75af78bbc8)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (571cb78b-deb6-4d0a-93ad-0ac90e047549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (571cb78b-deb6-4d0a-93ad-0ac90e047549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279df465-ecdb-4bc0-831d-f09b336d74ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279df465-ecdb-4bc0-831d-f09b336d74ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70910014-74c8-4c41-8bf2-da2e2e999e9a', 'volume_name': 'volume-70910014-74c8-4c41-8bf2-da2e2e999e9a', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f702b5-699e-421e-a66f-e19dea0cc5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f702b5-699e-421e-a66f-e19dea0cc5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b78e24-61d4-4b39-a7a8-0b39277c3b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:30 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Volume 70910014-74c8-4c41-8bf2-da2e2e999e9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70910014-74c8-4c41-8bf2-da2e2e999e9a', 'volume_size': 1} Nov 03 07:35:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=909c561f-e134-41d5-808d-c6a6a3fe6c90,created_at=2026-11-03T06:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2136258840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=909c561f-e134-41d5-808d-c6a6a3fe6c90,host='devstack@QuobyteHD#QuobyteHD',id=70910014-74c8-4c41-8bf2-da2e2e999e9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec00fdc919c44a829367c4a18461c67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:30Z,use_quota=True,user_id='ebafe56c6d824d3fb3fac45267fb9b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3feb7806-200a-470e-88ee-7f75af78bbc8),volume_type_id=3feb7806-200a-470e-88ee-7f75af78bbc8)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:35:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Creating volume 70910014-74c8-4c41-8bf2-da2e2e999e9a {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:35:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:35:30 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:35:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-70910014-74c8-4c41-8bf2-da2e2e999e9a 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:30 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-70910014-74c8-4c41-8bf2-da2e2e999e9a 1073741824 Nov 03 07:35:30 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:31 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-70910014-74c8-4c41-8bf2-da2e2e999e9a 1073741824" returned: 0 in 0.711s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-70910014-74c8-4c41-8bf2-da2e2e999e9a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:31 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-70910014-74c8-4c41-8bf2-da2e2e999e9a Nov 03 07:35:31 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:31 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-70910014-74c8-4c41-8bf2-da2e2e999e9a" returned: 0 in 0.452s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:31 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:35:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b78e24-61d4-4b39-a7a8-0b39277c3b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70910014-74c8-4c41-8bf2-da2e2e999e9a', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b71d635-46d1-4a9e-bd6f-a6a38dbd8619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:31 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Volume volume-70910014-74c8-4c41-8bf2-da2e2e999e9a (70910014-74c8-4c41-8bf2-da2e2e999e9a): created successfully Nov 03 07:35:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b71d635-46d1-4a9e-bd6f-a6a38dbd8619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Flow 'volume_create_manager' (5950b603-820f-4931-af93-880971abd863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:31 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-3a5542ca-274c-4760-82a6-a99c26c69ab3 tempest-GroupsTest-1573866207 None] Created volume successfully. Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Flow 'volume_create_manager' (f3d96c05-e363-4aa9-a88f-ea7224229abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ec2596-694d-4c4e-8302-3e2dc433e3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ec2596-694d-4c4e-8302-3e2dc433e3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1649150162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=909c561f-e134-41d5-808d-c6a6a3fe6c90,host='devstack@QuobyteHD#QuobyteHD',id=fd788517-f619-44f3-a50f-60b3ab8faa1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec00fdc919c44a829367c4a18461c67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:34Z,use_quota=True,user_id='ebafe56c6d824d3fb3fac45267fb9b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3feb7806-200a-470e-88ee-7f75af78bbc8),volume_type_id=3feb7806-200a-470e-88ee-7f75af78bbc8)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c4aca0-d78a-4ede-add8-4dd8d6f65291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c4aca0-d78a-4ede-add8-4dd8d6f65291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf61c553-0372-4705-93ac-02c7d3acb691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf61c553-0372-4705-93ac-02c7d3acb691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd788517-f619-44f3-a50f-60b3ab8faa1d', 'volume_name': 'volume-fd788517-f619-44f3-a50f-60b3ab8faa1d', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6ee328-04f3-4746-862c-0dd762d3e13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6ee328-04f3-4746-862c-0dd762d3e13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f69f2ce-26e9-4cd5-91eb-6b94c74c1cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:34 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Volume fd788517-f619-44f3-a50f-60b3ab8faa1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd788517-f619-44f3-a50f-60b3ab8faa1d', 'volume_size': 1} Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=909c561f-e134-41d5-808d-c6a6a3fe6c90,created_at=2026-11-03T06:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1649150162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=909c561f-e134-41d5-808d-c6a6a3fe6c90,host='devstack@QuobyteHD#QuobyteHD',id=fd788517-f619-44f3-a50f-60b3ab8faa1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec00fdc919c44a829367c4a18461c67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:34Z,use_quota=True,user_id='ebafe56c6d824d3fb3fac45267fb9b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3feb7806-200a-470e-88ee-7f75af78bbc8),volume_type_id=3feb7806-200a-470e-88ee-7f75af78bbc8)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Creating volume fd788517-f619-44f3-a50f-60b3ab8faa1d {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:35:34 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fd788517-f619-44f3-a50f-60b3ab8faa1d 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:34 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fd788517-f619-44f3-a50f-60b3ab8faa1d 1073741824 Nov 03 07:35:34 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:34 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fd788517-f619-44f3-a50f-60b3ab8faa1d 1073741824" returned: 0 in 0.574s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fd788517-f619-44f3-a50f-60b3ab8faa1d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:34 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fd788517-f619-44f3-a50f-60b3ab8faa1d Nov 03 07:35:34 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:35 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fd788517-f619-44f3-a50f-60b3ab8faa1d" returned: 0 in 0.451s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:35:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:35 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f69f2ce-26e9-4cd5-91eb-6b94c74c1cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd788517-f619-44f3-a50f-60b3ab8faa1d', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:35 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (135fa9ac-57a7-4d89-9392-96d8a878597d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:35 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Volume volume-fd788517-f619-44f3-a50f-60b3ab8faa1d (fd788517-f619-44f3-a50f-60b3ab8faa1d): created successfully Nov 03 07:35:35 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (135fa9ac-57a7-4d89-9392-96d8a878597d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:35 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Flow 'volume_create_manager' (f3d96c05-e363-4aa9-a88f-ea7224229abd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:35 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-3c9c9c06-2025-4f45-a490-a2da499755e8 tempest-GroupsTest-1573866207 None] Created volume successfully. Nov 03 07:35:36 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-1896a8ae-48e6-4319-a64a-7bbaf30258f4 tempest-GroupsTest-1573866207 None] Update group completed successfully. Nov 03 07:35:37 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:35:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Flow 'volume_create_manager' (b26100f5-9459-4e93-8374-5eb7def9f847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530e4f68-68c4-45f8-bb4e-1df9b31bdf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530e4f68-68c4-45f8-bb4e-1df9b31bdf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-428161351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56cc3f9654e04635b82aaff883df1e79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:37Z,use_quota=True,user_id='a7a38c0dc6fe4699a079478e129a3f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcd2c9f-5226-48bf-943a-c87f16c064fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcd2c9f-5226-48bf-943a-c87f16c064fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf49a182-ac41-4b5f-a0d7-7bea217220ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:37 devstack cinder-volume[87016]: DEBUG cinder.image.glance [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Creating Keystone auth plugin from conf {{(pid=87016) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:35:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf49a182-ac41-4b5f-a0d7-7bea217220ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4', 'volume_name': 'volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4', 'volume_size': 1, 'image_id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bde64ec799a64fc39c0407ed31a11129', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'created_at': datetime.datetime(2026, 11, 3, 6, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3313ed46-2360-4d03-8400-ac90ef102984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3313ed46-2360-4d03-8400-ac90ef102984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ad37fd-b215-4d0a-b4dd-90fc6a8ca2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:37 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Volume f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4', 'volume_size': 1, 'image_id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bde64ec799a64fc39c0407ed31a11129', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'created_at': datetime.datetime(2026, 11, 3, 6, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 07:35:37 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Trying to clone f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 from image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb at location (None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}]). {{(pid=87016) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:35:38 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_hq6zssj9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:35:38 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Image download 20.69 MB at 20.69 MB/s Nov 03 07:35:38 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c87fc7-94dd-4708-889f-80aeed34e851]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_hq6zssj9devstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:38 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-7252a9ef-163e-4b4f-b030-eb41578ce7c6 tempest-GroupsTest-1573866207 None] Update group completed successfully. Nov 03 07:35:38 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_hq6zssj9devstack@QuobyteHD Nov 03 07:35:38 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:39 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_hq6zssj9devstack@QuobyteHD" returned: 0 in 0.506s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:39 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Temporary image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb is fetched for user a7a38c0dc6fe4699a079478e129a3f71. {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:35:39 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fae0494-39ff-459b-8816-b80af5d4dcd0]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_hq6zssj9devstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:39 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_hq6zssj9devstack@QuobyteHD Nov 03 07:35:39 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:39 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_hq6zssj9devstack@QuobyteHD" returned: 0 in 0.450s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-428161351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56cc3f9654e04635b82aaff883df1e79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:37Z,use_quota=True,user_id='a7a38c0dc6fe4699a079478e129a3f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:35:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Creating volume f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:35:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:35:39 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:35:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:39 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 1073741824 Nov 03 07:35:39 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:40 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 1073741824" returned: 0 in 0.811s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:40 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 Nov 03 07:35:40 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:41 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4" returned: 0 in 0.514s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:41 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:35:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:41 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Attempting download of 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb ((None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}])) to volume f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4. {{(pid=87016) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 03 07:35:41 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88a89dc-4e7e-4e00-b831-501e5057b915]: (4, 'raw') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_ev8p821d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:41 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] Acquiring lock "cinder-quobyte-70910014-74c8-4c41-8bf2-da2e2e999e9a" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:41 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] Lock "cinder-quobyte-70910014-74c8-4c41-8bf2-da2e2e999e9a" acquired by "delete_volume" :: waited 0.040s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:41 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[4682e29c-aa61-4a6c-8254-d65979ea1034]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-70910014-74c8-4c41-8bf2-da2e2e999e9a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:41 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_ev8p821d Nov 03 07:35:41 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:41 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-70910014-74c8-4c41-8bf2-da2e2e999e9a Nov 03 07:35:41 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:41 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_ev8p821d" returned: 0 in 0.666s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_ev8p821d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:41 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-70910014-74c8-4c41-8bf2-da2e2e999e9a" returned: 0 in 0.630s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-70910014-74c8-4c41-8bf2-da2e2e999e9a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:42 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-70910014-74c8-4c41-8bf2-da2e2e999e9a Nov 03 07:35:42 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:42 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_ev8p821d Nov 03 07:35:42 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:42 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_ev8p821d" returned: 1 in 0.574s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_ev8p821d' failed. Not Retrying. {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:35:42 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e3bb15-28f7-403e-a4bd-d86b8545fcc1]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_hq6zssj9devstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:42 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-70910014-74c8-4c41-8bf2-da2e2e999e9a" returned: 0 in 0.540s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:42 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] Lock "cinder-quobyte-70910014-74c8-4c41-8bf2-da2e2e999e9a" released by "delete_volume" :: held 1.256s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:42 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] Acquiring lock "cinder-quobyte-fd788517-f619-44f3-a50f-60b3ab8faa1d" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:42 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] Lock "cinder-quobyte-fd788517-f619-44f3-a50f-60b3ab8faa1d" acquired by "delete_volume" :: waited 0.031s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:42 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec7e91c-8afe-43df-9fb6-660cd5a88e68]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fd788517-f619-44f3-a50f-60b3ab8faa1d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:42 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_hq6zssj9devstack@QuobyteHD Nov 03 07:35:42 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:42 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fd788517-f619-44f3-a50f-60b3ab8faa1d Nov 03 07:35:42 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:43 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_hq6zssj9devstack@QuobyteHD" returned: 0 in 0.672s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:43 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb was qcow2, converting to qcow2 {{(pid=87016) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:35:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_hq6zssj9devstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:43 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_hq6zssj9devstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 Nov 03 07:35:43 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:43 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fd788517-f619-44f3-a50f-60b3ab8faa1d" returned: 0 in 0.845s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fd788517-f619-44f3-a50f-60b3ab8faa1d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:43 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fd788517-f619-44f3-a50f-60b3ab8faa1d Nov 03 07:35:43 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:43 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fd788517-f619-44f3-a50f-60b3ab8faa1d" returned: 0 in 0.461s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] Lock "cinder-quobyte-fd788517-f619-44f3-a50f-60b3ab8faa1d" released by "delete_volume" :: held 1.380s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:44 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] Created reservations ['695e4f89-a9fb-4c52-b56a-bd11e795f0af'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:35:44 devstack cinder-volume[87016]: WARNING cinder.quota [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2020360092 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2020360092, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:35:44 devstack cinder-volume[87016]: WARNING cinder.quota [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2020360092 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2020360092, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:35:44 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] Created reservations ['f0cbad53-5a5c-4321-b85e-158faa4c9059', '8fbb63cb-bf50-4ceb-94ce-0ffd303595c7', '8a9deb4c-62e2-418e-b9b4-5468c686b94e', '0d020516-96f4-4e2d-8a78-7d207f3c7436'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:35:44 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] Created reservations ['177064f7-4705-467a-9ae0-23bec6777e48', 'd9389ccd-2b62-4b6b-9229-3a4140d2f63f', 'df00080c-5772-4588-80f4-736928374344', '337cd3ef-382f-4bfb-9bfc-523236021897'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:35:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:44 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:35:44 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:45 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.386s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:45 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:35:45 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-400a1e39-954d-482e-a9eb-b24285c71564 tempest-GroupsTest-1573866207 None] Delete group completed successfully. Nov 03 07:35:46 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_hq6zssj9devstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4" returned: 0 in 3.569s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:46 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_hq6zssj9devstack@QuobyteHD, size 112.00 MB, duration 3.57 sec, destination /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:35:46 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Converted 112.00 MB image at 31.35 MB/s Nov 03 07:35:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:46 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 1G Nov 03 07:35:46 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:47 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 1G" returned: 0 in 0.593s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:47 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Downloaded image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb ((None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}])) to volume f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 successfully. {{(pid=87016) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 03 07:35:47 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Temporary image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb for user a7a38c0dc6fe4699a079478e129a3f71 is deleted. {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:35:47 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Marking volume f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 as bootable. {{(pid=87016) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 03 07:35:47 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Copying metadata from image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb to f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4. {{(pid=87016) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:35:47 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Creating volume glance metadata for volume f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 backed by image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87016) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:35:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ad37fd-b215-4d0a-b4dd-90fc6a8ca2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4', 'volume_size': 1, 'image_id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bde64ec799a64fc39c0407ed31a11129', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'created_at': datetime.datetime(2026, 11, 3, 6, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261b116d-387d-4785-adbd-44f3b62105b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:47 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Volume volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 (f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4): created successfully Nov 03 07:35:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261b116d-387d-4785-adbd-44f3b62105b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Flow 'volume_create_manager' (b26100f5-9459-4e93-8374-5eb7def9f847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:47 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-46eda680-e692-4108-b59b-d6ea91ec2e94 tempest-VolumesExtendTest-1645303897 None] Created volume successfully. Nov 03 07:35:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:35:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:49 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:35:49 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f701693c-be76-4840-9523-fe07554554fd tempest-VolumesExtendTest-1645303897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f701693c-be76-4840-9523-fe07554554fd tempest-VolumesExtendTest-1645303897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:49 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d61624-8577-4f59-a6d6-738bbf0eb411]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f701693c-be76-4840-9523-fe07554554fd tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:49 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 Nov 03 07:35:49 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:49 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.558s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:35:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:35:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 28 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:35:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:35:50 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f701693c-be76-4840-9523-fe07554554fd tempest-VolumesExtendTest-1645303897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4" returned: 0 in 0.528s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f701693c-be76-4840-9523-fe07554554fd tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 2G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f701693c-be76-4840-9523-fe07554554fd tempest-VolumesExtendTest-1645303897 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 2G" returned: 0 in 0.169s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f701693c-be76-4840-9523-fe07554554fd tempest-VolumesExtendTest-1645303897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.760s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:50 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=130,cinder:UPDATE=147,cinder:INSERT=35,cinder:DELETE=6 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:35:50 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=124,cinder:INSERT=44,cinder:UPDATE=149,cinder:DELETE=8 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:35:50 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-f701693c-be76-4840-9523-fe07554554fd tempest-VolumesExtendTest-1645303897 None] Extend volume completed successfully. Nov 03 07:35:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-37213963-fc21-4046-9125-9d277652f92c tempest-VolumesExtendTest-1645303897 None] Acquiring lock "cinder-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-37213963-fc21-4046-9125-9d277652f92c tempest-VolumesExtendTest-1645303897 None] Lock "cinder-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-37213963-fc21-4046-9125-9d277652f92c tempest-VolumesExtendTest-1645303897 None] Acquiring lock "cinder-quobyte-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-37213963-fc21-4046-9125-9d277652f92c tempest-VolumesExtendTest-1645303897 None] Lock "cinder-quobyte-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4" acquired by "delete_volume" :: waited 0.016s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:51 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[482ae49a-0018-4b8e-b2ad-465bea82da2c]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-37213963-fc21-4046-9125-9d277652f92c tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:52 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 Nov 03 07:35:52 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:52 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-37213963-fc21-4046-9125-9d277652f92c tempest-VolumesExtendTest-1645303897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4" returned: 0 in 0.661s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-37213963-fc21-4046-9125-9d277652f92c tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:52 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4 Nov 03 07:35:52 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:53 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-37213963-fc21-4046-9125-9d277652f92c tempest-VolumesExtendTest-1645303897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4" returned: 0 in 0.562s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-37213963-fc21-4046-9125-9d277652f92c tempest-VolumesExtendTest-1645303897 None] Lock "cinder-quobyte-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4" released by "delete_volume" :: held 1.299s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:53 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-37213963-fc21-4046-9125-9d277652f92c tempest-VolumesExtendTest-1645303897 None] Created reservations ['aa00b548-601b-44de-8de5-a8d5fead5c8f', '187509c0-01dd-412d-b759-21a4cadc9fdd', '271a98d5-a750-4b2f-b522-8bea1c92ecd2', 'df68da25-8954-4398-a48d-93e9b702213e'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:35:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-37213963-fc21-4046-9125-9d277652f92c tempest-VolumesExtendTest-1645303897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-37213963-fc21-4046-9125-9d277652f92c tempest-VolumesExtendTest-1645303897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-37213963-fc21-4046-9125-9d277652f92c tempest-VolumesExtendTest-1645303897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-37213963-fc21-4046-9125-9d277652f92c tempest-VolumesExtendTest-1645303897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-37213963-fc21-4046-9125-9d277652f92c tempest-VolumesExtendTest-1645303897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-37213963-fc21-4046-9125-9d277652f92c tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:53 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:35:53 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:54 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-37213963-fc21-4046-9125-9d277652f92c tempest-VolumesExtendTest-1645303897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.637s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:54 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-37213963-fc21-4046-9125-9d277652f92c tempest-VolumesExtendTest-1645303897 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:35:54 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-37213963-fc21-4046-9125-9d277652f92c tempest-VolumesExtendTest-1645303897 None] Deleted volume successfully. Nov 03 07:35:54 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-37213963-fc21-4046-9125-9d277652f92c tempest-VolumesExtendTest-1645303897 None] Lock "cinder-f9f8abc2-1b24-4ec8-ab2f-93b9f44f1ab4-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Flow 'volume_create_manager' (9750fb41-541f-45d2-8a3d-612ee3254f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d493c7-39e9-4e9c-8f82-7cc083dbe898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d493c7-39e9-4e9c-8f82-7cc083dbe898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1873137485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a9eee0e-ebeb-47f5-989d-ebc55bc293d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56cc3f9654e04635b82aaff883df1e79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:55Z,use_quota=True,user_id='a7a38c0dc6fe4699a079478e129a3f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe9c0b2-5dba-4f43-8161-d2bf00e21d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe9c0b2-5dba-4f43-8161-d2bf00e21d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c52ecb-cdd3-42c1-9b36-6842aae28227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c52ecb-cdd3-42c1-9b36-6842aae28227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a9eee0e-ebeb-47f5-989d-ebc55bc293d5', 'volume_name': 'volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee7c9bb-3e72-4f13-b4a4-649482698943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee7c9bb-3e72-4f13-b4a4-649482698943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a169700-a534-4a9f-bb6b-98d76e98a6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:55 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Volume 4a9eee0e-ebeb-47f5-989d-ebc55bc293d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5', 'volume_size': 1} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1873137485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a9eee0e-ebeb-47f5-989d-ebc55bc293d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56cc3f9654e04635b82aaff883df1e79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:55Z,use_quota=True,user_id='a7a38c0dc6fe4699a079478e129a3f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Creating volume 4a9eee0e-ebeb-47f5-989d-ebc55bc293d5 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:35:55 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:35:55 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5 1073741824 Nov 03 07:35:55 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Flow 'volume_create_manager' (df1b4f01-1df1-4185-bbeb-dcf61fc6f249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (864c28b2-0550-40ce-98f3-8cee373f7a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (864c28b2-0550-40ce-98f3-8cee373f7a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-205681752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50873719-cb82-40ea-9942-091e202032da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='061e9ae666054c0a916e20e4406c4655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:56Z,use_quota=True,user_id='683ae17748b240aa9eef082600409f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (617bc352-ca00-46e4-85d9-69ac1b967aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (617bc352-ca00-46e4-85d9-69ac1b967aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f7586b7-5eee-4fd6-86bc-b2da5ddc0feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f7586b7-5eee-4fd6-86bc-b2da5ddc0feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50873719-cb82-40ea-9942-091e202032da', 'volume_name': 'volume-50873719-cb82-40ea-9942-091e202032da', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1cc135c-617c-4963-b8a7-b17ea4808e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1cc135c-617c-4963-b8a7-b17ea4808e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb64a0e-f07c-4f61-8d23-69d9f31f39e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:56 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Volume 50873719-cb82-40ea-9942-091e202032da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50873719-cb82-40ea-9942-091e202032da', 'volume_size': 1} Nov 03 07:35:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:56 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5 1073741824" returned: 0 in 0.892s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:56 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5 Nov 03 07:35:56 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:57 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5" returned: 0 in 0.401s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:57 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:35:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.102s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:57 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-205681752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50873719-cb82-40ea-9942-091e202032da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='061e9ae666054c0a916e20e4406c4655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:56Z,use_quota=True,user_id='683ae17748b240aa9eef082600409f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:35:57 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Creating volume 50873719-cb82-40ea-9942-091e202032da {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:35:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:57 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:57 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:57 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:35:57 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:35:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50873719-cb82-40ea-9942-091e202032da 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a169700-a534-4a9f-bb6b-98d76e98a6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:57 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50873719-cb82-40ea-9942-091e202032da 1073741824 Nov 03 07:35:57 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df420ff6-d533-4b8b-868e-a2625f57e9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:57 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Volume volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5 (4a9eee0e-ebeb-47f5-989d-ebc55bc293d5): created successfully Nov 03 07:35:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df420ff6-d533-4b8b-868e-a2625f57e9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Flow 'volume_create_manager' (9750fb41-541f-45d2-8a3d-612ee3254f5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:57 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-1c1cc005-58fa-4f7d-9858-f72f73ec1e60 tempest-VolumesExtendTest-1645303897 None] Created volume successfully. Nov 03 07:35:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1e16a129-632e-4fa2-bafa-399f8006882f tempest-VolumesExtendTest-1645303897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:57 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50873719-cb82-40ea-9942-091e202032da 1073741824" returned: 0 in 0.863s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50873719-cb82-40ea-9942-091e202032da {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:58 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50873719-cb82-40ea-9942-091e202032da Nov 03 07:35:58 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:58 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50873719-cb82-40ea-9942-091e202032da" returned: 0 in 0.331s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:35:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1e16a129-632e-4fa2-bafa-399f8006882f tempest-VolumesExtendTest-1645303897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.442s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-1e16a129-632e-4fa2-bafa-399f8006882f tempest-VolumesExtendTest-1645303897 None] Creating offline snapshot 4b9a9913-4ac1-464b-bdbc-1b3e21b4b767 of volume 4a9eee0e-ebeb-47f5-989d-ebc55bc293d5 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:35:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb64a0e-f07c-4f61-8d23-69d9f31f39e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50873719-cb82-40ea-9942-091e202032da', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2de4270-a6d4-4031-8395-a500fb63da44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:58 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc77c0ac-e78b-43d6-a745-32a2ced2cb4f]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1e16a129-632e-4fa2-bafa-399f8006882f tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:58 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Volume volume-50873719-cb82-40ea-9942-091e202032da (50873719-cb82-40ea-9942-091e202032da): created successfully Nov 03 07:35:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2de4270-a6d4-4031-8395-a500fb63da44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Flow 'volume_create_manager' (df1b4f01-1df1-4185-bbeb-dcf61fc6f249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:58 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-e1a84254-caa2-4a9f-8e03-3809cd87fed8 tempest-TestMinimumBasicScenario-93624314 None] Created volume successfully. Nov 03 07:35:58 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5 Nov 03 07:35:58 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:59 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1e16a129-632e-4fa2-bafa-399f8006882f tempest-VolumesExtendTest-1645303897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5" returned: 0 in 0.709s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1e16a129-632e-4fa2-bafa-399f8006882f tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.4b9a9913-4ac1-464b-bdbc-1b3e21b4b767 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:59 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.4b9a9913-4ac1-464b-bdbc-1b3e21b4b767 1G Nov 03 07:35:59 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:59 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1e16a129-632e-4fa2-bafa-399f8006882f tempest-VolumesExtendTest-1645303897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.4b9a9913-4ac1-464b-bdbc-1b3e21b4b767 1G" returned: 0 in 0.755s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1e16a129-632e-4fa2-bafa-399f8006882f tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.4b9a9913-4ac1-464b-bdbc-1b3e21b4b767 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:00 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.4b9a9913-4ac1-464b-bdbc-1b3e21b4b767 Nov 03 07:36:00 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:00 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1e16a129-632e-4fa2-bafa-399f8006882f tempest-VolumesExtendTest-1645303897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.4b9a9913-4ac1-464b-bdbc-1b3e21b4b767" returned: 0 in 0.535s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:00 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-1e16a129-632e-4fa2-bafa-399f8006882f tempest-VolumesExtendTest-1645303897 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.4b9a9913-4ac1-464b-bdbc-1b3e21b4b767 is being set with open permissions: ugo+rw Nov 03 07:36:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1e16a129-632e-4fa2-bafa-399f8006882f tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.4b9a9913-4ac1-464b-bdbc-1b3e21b4b767 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:00 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.4b9a9913-4ac1-464b-bdbc-1b3e21b4b767 Nov 03 07:36:00 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:01 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1e16a129-632e-4fa2-bafa-399f8006882f tempest-VolumesExtendTest-1645303897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.4b9a9913-4ac1-464b-bdbc-1b3e21b4b767" returned: 0 in 0.517s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1e16a129-632e-4fa2-bafa-399f8006882f tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:01 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.info Nov 03 07:36:01 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:01 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1e16a129-632e-4fa2-bafa-399f8006882f tempest-VolumesExtendTest-1645303897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.info" returned: 0 in 0.498s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:01 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-1e16a129-632e-4fa2-bafa-399f8006882f tempest-VolumesExtendTest-1645303897 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.info is being set with open permissions: ugo+rw Nov 03 07:36:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1e16a129-632e-4fa2-bafa-399f8006882f tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-6cd3fbe8-bbae-4198-8d2e-9d2f4f3c330e req-acf4e042-65b2-4a78-8bbb-57e8d48083ee tempest-TestMinimumBasicScenario-93624314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:01 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.info Nov 03 07:36:01 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:02 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1e16a129-632e-4fa2-bafa-399f8006882f tempest-VolumesExtendTest-1645303897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.info" returned: 0 in 0.473s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1e16a129-632e-4fa2-bafa-399f8006882f tempest-VolumesExtendTest-1645303897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.790s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-6cd3fbe8-bbae-4198-8d2e-9d2f4f3c330e req-acf4e042-65b2-4a78-8bbb-57e8d48083ee tempest-TestMinimumBasicScenario-93624314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.484s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-6cd3fbe8-bbae-4198-8d2e-9d2f4f3c330e req-acf4e042-65b2-4a78-8bbb-57e8d48083ee tempest-TestMinimumBasicScenario-93624314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:02 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-1e16a129-632e-4fa2-bafa-399f8006882f tempest-VolumesExtendTest-1645303897 None] Create snapshot completed successfully Nov 03 07:36:02 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-6cd3fbe8-bbae-4198-8d2e-9d2f4f3c330e req-acf4e042-65b2-4a78-8bbb-57e8d48083ee tempest-TestMinimumBasicScenario-93624314 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14', 'name': 'volume-50873719-cb82-40ea-9942-091e202032da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17d8ab61-c848-41a7-a4c7-9ada8b869bfa', 'enforce_multipath': True} {{(pid=87016) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:36:02 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-6cd3fbe8-bbae-4198-8d2e-9d2f4f3c330e req-acf4e042-65b2-4a78-8bbb-57e8d48083ee tempest-TestMinimumBasicScenario-93624314 None] attachment_update completed successfully. Nov 03 07:36:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d08039be-8ee3-430b-93df-3bc977adc9c9 tempest-VolumesExtendTest-1645303897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d08039be-8ee3-430b-93df-3bc977adc9c9 tempest-VolumesExtendTest-1645303897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:03 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbff753a-9326-4c53-9169-3d6d5d618b1c]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d08039be-8ee3-430b-93df-3bc977adc9c9 tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:03 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5 Nov 03 07:36:03 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:04 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d08039be-8ee3-430b-93df-3bc977adc9c9 tempest-VolumesExtendTest-1645303897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5" returned: 0 in 0.520s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d08039be-8ee3-430b-93df-3bc977adc9c9 tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.4b9a9913-4ac1-464b-bdbc-1b3e21b4b767 2G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d08039be-8ee3-430b-93df-3bc977adc9c9 tempest-VolumesExtendTest-1645303897 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.4b9a9913-4ac1-464b-bdbc-1b3e21b4b767 2G" returned: 0 in 0.227s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d08039be-8ee3-430b-93df-3bc977adc9c9 tempest-VolumesExtendTest-1645303897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.816s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:04 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-d08039be-8ee3-430b-93df-3bc977adc9c9 tempest-VolumesExtendTest-1645303897 None] Extend volume completed successfully. Nov 03 07:36:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b420dfeb-df34-44f0-a1ce-2d5657ae5c7c tempest-VolumesExtendTest-1645303897 None] Acquiring lock "cinder-4b9a9913-4ac1-464b-bdbc-1b3e21b4b767-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b420dfeb-df34-44f0-a1ce-2d5657ae5c7c tempest-VolumesExtendTest-1645303897 None] Lock "cinder-4b9a9913-4ac1-464b-bdbc-1b3e21b4b767-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b420dfeb-df34-44f0-a1ce-2d5657ae5c7c tempest-VolumesExtendTest-1645303897 None] Acquiring lock "cinder-quobyte-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b420dfeb-df34-44f0-a1ce-2d5657ae5c7c tempest-VolumesExtendTest-1645303897 None] Lock "cinder-quobyte-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b420dfeb-df34-44f0-a1ce-2d5657ae5c7c tempest-VolumesExtendTest-1645303897 None] Acquiring lock "cinder-quobyte-4b9a9913-4ac1-464b-bdbc-1b3e21b4b767" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b420dfeb-df34-44f0-a1ce-2d5657ae5c7c tempest-VolumesExtendTest-1645303897 None] Lock "cinder-quobyte-4b9a9913-4ac1-464b-bdbc-1b3e21b4b767" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-b420dfeb-df34-44f0-a1ce-2d5657ae5c7c tempest-VolumesExtendTest-1645303897 None] Deleting offline snapshot 4b9a9913-4ac1-464b-bdbc-1b3e21b4b767 of volume 4a9eee0e-ebeb-47f5-989d-ebc55bc293d5 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:36:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-b420dfeb-df34-44f0-a1ce-2d5657ae5c7c tempest-VolumesExtendTest-1645303897 None] snapshot_file for this snap is: volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.4b9a9913-4ac1-464b-bdbc-1b3e21b4b767 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:36:05 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb9c2d4-2ec5-4cee-b756-97638f19adc5]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b420dfeb-df34-44f0-a1ce-2d5657ae5c7c tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.4b9a9913-4ac1-464b-bdbc-1b3e21b4b767 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:05 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.4b9a9913-4ac1-464b-bdbc-1b3e21b4b767 Nov 03 07:36:05 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:05 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b420dfeb-df34-44f0-a1ce-2d5657ae5c7c tempest-VolumesExtendTest-1645303897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.4b9a9913-4ac1-464b-bdbc-1b3e21b4b767" returned: 0 in 0.631s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-b420dfeb-df34-44f0-a1ce-2d5657ae5c7c tempest-VolumesExtendTest-1645303897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:36:05 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd13c787-e2bf-445d-bee9-62b35807e3ee]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b420dfeb-df34-44f0-a1ce-2d5657ae5c7c tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:06 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5 Nov 03 07:36:06 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:06 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b420dfeb-df34-44f0-a1ce-2d5657ae5c7c tempest-VolumesExtendTest-1645303897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5" returned: 0 in 0.610s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b420dfeb-df34-44f0-a1ce-2d5657ae5c7c tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.4b9a9913-4ac1-464b-bdbc-1b3e21b4b767 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:06 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.4b9a9913-4ac1-464b-bdbc-1b3e21b4b767 Nov 03 07:36:06 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:07 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b420dfeb-df34-44f0-a1ce-2d5657ae5c7c tempest-VolumesExtendTest-1645303897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.4b9a9913-4ac1-464b-bdbc-1b3e21b4b767" returned: 0 in 0.512s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b420dfeb-df34-44f0-a1ce-2d5657ae5c7c tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.4b9a9913-4ac1-464b-bdbc-1b3e21b4b767 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:07 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.4b9a9913-4ac1-464b-bdbc-1b3e21b4b767 Nov 03 07:36:07 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:07 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b420dfeb-df34-44f0-a1ce-2d5657ae5c7c tempest-VolumesExtendTest-1645303897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5.4b9a9913-4ac1-464b-bdbc-1b3e21b4b767" returned: 0 in 0.351s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:07 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b420dfeb-df34-44f0-a1ce-2d5657ae5c7c tempest-VolumesExtendTest-1645303897 None] Lock "cinder-quobyte-4b9a9913-4ac1-464b-bdbc-1b3e21b4b767" released by "_delete_snapshot" :: held 2.338s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:07 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b420dfeb-df34-44f0-a1ce-2d5657ae5c7c tempest-VolumesExtendTest-1645303897 None] Lock "cinder-quobyte-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5" released by "delete_snapshot" :: held 2.384s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:07 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-b420dfeb-df34-44f0-a1ce-2d5657ae5c7c tempest-VolumesExtendTest-1645303897 None] Created reservations ['e29d12e6-49ce-42f1-96d5-5a07cbc9ca57', 'd9b5b3c7-d5b0-405e-805a-e505a33fe882', 'd0474379-8a06-4489-9331-5f6da9df34b3', '64ff60a7-52e9-4932-ab7a-322db33ef955'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:36:07 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b420dfeb-df34-44f0-a1ce-2d5657ae5c7c tempest-VolumesExtendTest-1645303897 None] Delete snapshot completed successfully. Nov 03 07:36:07 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b420dfeb-df34-44f0-a1ce-2d5657ae5c7c tempest-VolumesExtendTest-1645303897 None] Lock "cinder-4b9a9913-4ac1-464b-bdbc-1b3e21b4b767-delete_snapshot" released by "delete_snapshot" :: held 2.608s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:08 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0af98d8d-6c1f-4a6d-81fa-0b4ae0ad81ec tempest-VolumesExtendTest-1645303897 None] Acquiring lock "cinder-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:08 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0af98d8d-6c1f-4a6d-81fa-0b4ae0ad81ec tempest-VolumesExtendTest-1645303897 None] Lock "cinder-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:08 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0af98d8d-6c1f-4a6d-81fa-0b4ae0ad81ec tempest-VolumesExtendTest-1645303897 None] Acquiring lock "cinder-quobyte-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:08 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0af98d8d-6c1f-4a6d-81fa-0b4ae0ad81ec tempest-VolumesExtendTest-1645303897 None] Lock "cinder-quobyte-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5" acquired by "delete_volume" :: waited 0.031s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:08 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d5f254-b501-41d8-83c0-a94561fbf0e2]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0af98d8d-6c1f-4a6d-81fa-0b4ae0ad81ec tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:08 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5 Nov 03 07:36:08 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:09 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0af98d8d-6c1f-4a6d-81fa-0b4ae0ad81ec tempest-VolumesExtendTest-1645303897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5" returned: 0 in 0.684s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0af98d8d-6c1f-4a6d-81fa-0b4ae0ad81ec tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:09 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5 Nov 03 07:36:09 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:09 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0af98d8d-6c1f-4a6d-81fa-0b4ae0ad81ec tempest-VolumesExtendTest-1645303897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5" returned: 0 in 0.412s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:09 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0af98d8d-6c1f-4a6d-81fa-0b4ae0ad81ec tempest-VolumesExtendTest-1645303897 None] Lock "cinder-quobyte-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5" released by "delete_volume" :: held 1.191s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:09 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-0af98d8d-6c1f-4a6d-81fa-0b4ae0ad81ec tempest-VolumesExtendTest-1645303897 None] Created reservations ['b4ca6911-6428-44a8-8e60-813d9ba0097d', 'd46e2aec-efd5-4c32-8a8c-7f47fe9297ed', 'c2f129a6-b6e2-4b81-a417-ebf19a06d361', 'ff293622-7f4d-449f-8dde-2e6365dc07c1'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:36:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0af98d8d-6c1f-4a6d-81fa-0b4ae0ad81ec tempest-VolumesExtendTest-1645303897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0af98d8d-6c1f-4a6d-81fa-0b4ae0ad81ec tempest-VolumesExtendTest-1645303897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:09 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0af98d8d-6c1f-4a6d-81fa-0b4ae0ad81ec tempest-VolumesExtendTest-1645303897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:09 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0af98d8d-6c1f-4a6d-81fa-0b4ae0ad81ec tempest-VolumesExtendTest-1645303897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0af98d8d-6c1f-4a6d-81fa-0b4ae0ad81ec tempest-VolumesExtendTest-1645303897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0af98d8d-6c1f-4a6d-81fa-0b4ae0ad81ec tempest-VolumesExtendTest-1645303897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:09 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:36:09 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:10 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0af98d8d-6c1f-4a6d-81fa-0b4ae0ad81ec tempest-VolumesExtendTest-1645303897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.330s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:10 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-0af98d8d-6c1f-4a6d-81fa-0b4ae0ad81ec tempest-VolumesExtendTest-1645303897 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:36:10 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-0af98d8d-6c1f-4a6d-81fa-0b4ae0ad81ec tempest-VolumesExtendTest-1645303897 None] Deleted volume successfully. Nov 03 07:36:10 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0af98d8d-6c1f-4a6d-81fa-0b4ae0ad81ec tempest-VolumesExtendTest-1645303897 None] Lock "cinder-4a9eee0e-ebeb-47f5-989d-ebc55bc293d5-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:18 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:36:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Flow 'volume_create_manager' (125a65de-4cdf-4a0d-8421-690213fb55e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8da4765-7056-4553-8d32-a3303bc3327e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8da4765-7056-4553-8d32-a3303bc3327e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1921829199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a74ae067-aee5-40f3-a1ef-42bdbd825ac2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4f3f09351454590955d6437ab0c6d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:18Z,use_quota=True,user_id='7a02cebfa0ff43c8be5133f9895912b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504f0dac-2485-4f37-bbad-6c82c8df6519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504f0dac-2485-4f37-bbad-6c82c8df6519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b58683-9372-461b-b778-72f700e1b4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b58683-9372-461b-b778-72f700e1b4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a74ae067-aee5-40f3-a1ef-42bdbd825ac2', 'volume_name': 'volume-a74ae067-aee5-40f3-a1ef-42bdbd825ac2', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad644a42-5cb1-44c5-95b0-c3c358c91ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad644a42-5cb1-44c5-95b0-c3c358c91ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d78cdd-375f-4ed8-87b3-bc635205fc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:18 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Volume a74ae067-aee5-40f3-a1ef-42bdbd825ac2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a74ae067-aee5-40f3-a1ef-42bdbd825ac2', 'volume_size': 1} Nov 03 07:36:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1921829199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a74ae067-aee5-40f3-a1ef-42bdbd825ac2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4f3f09351454590955d6437ab0c6d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:18Z,use_quota=True,user_id='7a02cebfa0ff43c8be5133f9895912b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:36:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Creating volume a74ae067-aee5-40f3-a1ef-42bdbd825ac2 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:36:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:36:18 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:36:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a74ae067-aee5-40f3-a1ef-42bdbd825ac2 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:18 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a74ae067-aee5-40f3-a1ef-42bdbd825ac2 1073741824 Nov 03 07:36:18 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:19 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a74ae067-aee5-40f3-a1ef-42bdbd825ac2 1073741824" returned: 0 in 0.911s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a74ae067-aee5-40f3-a1ef-42bdbd825ac2 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:19 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a74ae067-aee5-40f3-a1ef-42bdbd825ac2 Nov 03 07:36:19 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:19 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a74ae067-aee5-40f3-a1ef-42bdbd825ac2" returned: 0 in 0.467s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:36:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d78cdd-375f-4ed8-87b3-bc635205fc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a74ae067-aee5-40f3-a1ef-42bdbd825ac2', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229f6362-cf2a-4d13-8ec7-5a39a324a2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:19 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Volume volume-a74ae067-aee5-40f3-a1ef-42bdbd825ac2 (a74ae067-aee5-40f3-a1ef-42bdbd825ac2): created successfully Nov 03 07:36:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229f6362-cf2a-4d13-8ec7-5a39a324a2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Flow 'volume_create_manager' (125a65de-4cdf-4a0d-8421-690213fb55e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:19 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-9d19e80d-5c57-49ac-9815-360f66df81d9 tempest-VolumesListTestJSON-809862365 None] Created volume successfully. Nov 03 07:36:21 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:36:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Flow 'volume_create_manager' (d5e3fbaa-bcf8-464e-a553-2b38651212da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c59869-ff4c-4985-b895-5ea4c2473eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c59869-ff4c-4985-b895-5ea4c2473eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1883304211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8814aeca-76db-40dd-99b5-39ab69eb7af9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4f3f09351454590955d6437ab0c6d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:21Z,use_quota=True,user_id='7a02cebfa0ff43c8be5133f9895912b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80a05cd-8d74-45fe-aff3-1b48ed9484ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80a05cd-8d74-45fe-aff3-1b48ed9484ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd20b7a5-8493-414f-bca9-c17e87f243c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd20b7a5-8493-414f-bca9-c17e87f243c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8814aeca-76db-40dd-99b5-39ab69eb7af9', 'volume_name': 'volume-8814aeca-76db-40dd-99b5-39ab69eb7af9', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e1c9b8-cd72-416a-801d-3730c5fc8468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e1c9b8-cd72-416a-801d-3730c5fc8468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a367e632-bdfc-4103-b154-e240dfc2f590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:21 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Volume 8814aeca-76db-40dd-99b5-39ab69eb7af9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8814aeca-76db-40dd-99b5-39ab69eb7af9', 'volume_size': 1} Nov 03 07:36:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1883304211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8814aeca-76db-40dd-99b5-39ab69eb7af9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4f3f09351454590955d6437ab0c6d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:21Z,use_quota=True,user_id='7a02cebfa0ff43c8be5133f9895912b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:36:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Creating volume 8814aeca-76db-40dd-99b5-39ab69eb7af9 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:36:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:36:21 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:36:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8814aeca-76db-40dd-99b5-39ab69eb7af9 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:21 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8814aeca-76db-40dd-99b5-39ab69eb7af9 1073741824 Nov 03 07:36:21 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:22 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8814aeca-76db-40dd-99b5-39ab69eb7af9 1073741824" returned: 0 in 0.570s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8814aeca-76db-40dd-99b5-39ab69eb7af9 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:22 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8814aeca-76db-40dd-99b5-39ab69eb7af9 Nov 03 07:36:22 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:22 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8814aeca-76db-40dd-99b5-39ab69eb7af9" returned: 0 in 0.411s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:22 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:36:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a367e632-bdfc-4103-b154-e240dfc2f590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8814aeca-76db-40dd-99b5-39ab69eb7af9', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e89a44-1e92-4667-8bd2-997783206092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:22 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Volume volume-8814aeca-76db-40dd-99b5-39ab69eb7af9 (8814aeca-76db-40dd-99b5-39ab69eb7af9): created successfully Nov 03 07:36:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e89a44-1e92-4667-8bd2-997783206092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Flow 'volume_create_manager' (d5e3fbaa-bcf8-464e-a553-2b38651212da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:22 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-702a340a-c9f7-4180-879c-3f2466fb882f tempest-VolumesListTestJSON-809862365 None] Created volume successfully. Nov 03 07:36:24 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:36:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Flow 'volume_create_manager' (3a3e9a41-7ac5-404d-bbd0-a50472aa1f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b14780-6d37-4a27-ad03-bfa3e1190904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b14780-6d37-4a27-ad03-bfa3e1190904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1738029449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4cd3ed-61ab-492e-9645-baaae40fb0f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4f3f09351454590955d6437ab0c6d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:24Z,use_quota=True,user_id='7a02cebfa0ff43c8be5133f9895912b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f71efe8-6f7d-4e07-b5f7-01b34a0c4643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f71efe8-6f7d-4e07-b5f7-01b34a0c4643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8e92c3-8339-408a-9b47-34a1c870f6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8e92c3-8339-408a-9b47-34a1c870f6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc4cd3ed-61ab-492e-9645-baaae40fb0f8', 'volume_name': 'volume-cc4cd3ed-61ab-492e-9645-baaae40fb0f8', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e5458ba-46a9-4029-80bf-c802cc6fc038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e5458ba-46a9-4029-80bf-c802cc6fc038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a969586f-c13e-4c25-955d-a96843cb0cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:24 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Volume cc4cd3ed-61ab-492e-9645-baaae40fb0f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc4cd3ed-61ab-492e-9645-baaae40fb0f8', 'volume_size': 1} Nov 03 07:36:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:24 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1738029449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4cd3ed-61ab-492e-9645-baaae40fb0f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4f3f09351454590955d6437ab0c6d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:24Z,use_quota=True,user_id='7a02cebfa0ff43c8be5133f9895912b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:36:24 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Creating volume cc4cd3ed-61ab-492e-9645-baaae40fb0f8 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:36:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:24 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:24 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:24 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:36:24 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:36:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc4cd3ed-61ab-492e-9645-baaae40fb0f8 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:24 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc4cd3ed-61ab-492e-9645-baaae40fb0f8 1073741824 Nov 03 07:36:24 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:25 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc4cd3ed-61ab-492e-9645-baaae40fb0f8 1073741824" returned: 0 in 0.989s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc4cd3ed-61ab-492e-9645-baaae40fb0f8 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:25 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc4cd3ed-61ab-492e-9645-baaae40fb0f8 Nov 03 07:36:25 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:26 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc4cd3ed-61ab-492e-9645-baaae40fb0f8" returned: 0 in 0.445s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:36:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a969586f-c13e-4c25-955d-a96843cb0cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc4cd3ed-61ab-492e-9645-baaae40fb0f8', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7630f86e-ee9f-4a64-bd97-a3e1b7c8c25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:26 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Volume volume-cc4cd3ed-61ab-492e-9645-baaae40fb0f8 (cc4cd3ed-61ab-492e-9645-baaae40fb0f8): created successfully Nov 03 07:36:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7630f86e-ee9f-4a64-bd97-a3e1b7c8c25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Flow 'volume_create_manager' (3a3e9a41-7ac5-404d-bbd0-a50472aa1f07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:26 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-90707aed-a034-4c19-b36a-a4562f3138b5 tempest-VolumesListTestJSON-809862365 None] Created volume successfully. Nov 03 07:36:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-eb32cf30-1c2b-4564-b9c1-5a14929e5a0b tempest-VolumesListTestJSON-809862365 None] Acquiring lock "cinder-cc4cd3ed-61ab-492e-9645-baaae40fb0f8-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-eb32cf30-1c2b-4564-b9c1-5a14929e5a0b tempest-VolumesListTestJSON-809862365 None] Lock "cinder-cc4cd3ed-61ab-492e-9645-baaae40fb0f8-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-eb32cf30-1c2b-4564-b9c1-5a14929e5a0b tempest-VolumesListTestJSON-809862365 None] Acquiring lock "cinder-quobyte-cc4cd3ed-61ab-492e-9645-baaae40fb0f8" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-eb32cf30-1c2b-4564-b9c1-5a14929e5a0b tempest-VolumesListTestJSON-809862365 None] Lock "cinder-quobyte-cc4cd3ed-61ab-492e-9645-baaae40fb0f8" acquired by "delete_volume" :: waited 0.039s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:31 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05b8558-8f20-4e98-b26c-0b3e3ad74fe3]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-eb32cf30-1c2b-4564-b9c1-5a14929e5a0b tempest-VolumesListTestJSON-809862365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc4cd3ed-61ab-492e-9645-baaae40fb0f8 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:31 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc4cd3ed-61ab-492e-9645-baaae40fb0f8 Nov 03 07:36:31 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:32 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-eb32cf30-1c2b-4564-b9c1-5a14929e5a0b tempest-VolumesListTestJSON-809862365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc4cd3ed-61ab-492e-9645-baaae40fb0f8" returned: 0 in 0.730s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-eb32cf30-1c2b-4564-b9c1-5a14929e5a0b tempest-VolumesListTestJSON-809862365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc4cd3ed-61ab-492e-9645-baaae40fb0f8 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:32 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc4cd3ed-61ab-492e-9645-baaae40fb0f8 Nov 03 07:36:32 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:32 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-eb32cf30-1c2b-4564-b9c1-5a14929e5a0b tempest-VolumesListTestJSON-809862365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc4cd3ed-61ab-492e-9645-baaae40fb0f8" returned: 0 in 0.619s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-eb32cf30-1c2b-4564-b9c1-5a14929e5a0b tempest-VolumesListTestJSON-809862365 None] Lock "cinder-quobyte-cc4cd3ed-61ab-492e-9645-baaae40fb0f8" released by "delete_volume" :: held 1.462s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:32 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-eb32cf30-1c2b-4564-b9c1-5a14929e5a0b tempest-VolumesListTestJSON-809862365 None] Created reservations ['5bedd41a-75cf-49f2-9222-c5537fa32ad4', '669100e2-31a9-427f-b7df-bb381f12745b', 'bc3b53aa-5643-49f1-98d0-cf3e6a8c9238', 'e8220601-56f5-475c-b026-227daa639d7b'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Flow 'volume_create_manager' (b90a24a8-0876-4441-bb9e-a065cd27659f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2335af-efe8-404d-9d83-c443cf1e9c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2335af-efe8-404d-9d83-c443cf1e9c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-95526426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d20dd840-1620-4757-b659-8435a9cac3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a91151ff9440b0a979ed8854d1b724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:33Z,use_quota=True,user_id='bab04ce1b2b440c9966170230190cca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb114136-0cd0-4277-a505-fdf84a7c1619),volume_type_id=fb114136-0cd0-4277-a505-fdf84a7c1619)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1c3792-67d0-483b-970f-312d36121f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1c3792-67d0-483b-970f-312d36121f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57f6cb6-cb8e-400b-9ce8-574c5733f838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57f6cb6-cb8e-400b-9ce8-574c5733f838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd20dd840-1620-4757-b659-8435a9cac3dd', 'volume_name': 'volume-d20dd840-1620-4757-b659-8435a9cac3dd', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a22e42-4cde-4432-8cdb-1f14c71f83fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a22e42-4cde-4432-8cdb-1f14c71f83fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be60b43-369c-4479-9b15-db3780d03f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:33 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Volume d20dd840-1620-4757-b659-8435a9cac3dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d20dd840-1620-4757-b659-8435a9cac3dd', 'volume_size': 1} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-95526426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d20dd840-1620-4757-b659-8435a9cac3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a91151ff9440b0a979ed8854d1b724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:33Z,use_quota=True,user_id='bab04ce1b2b440c9966170230190cca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb114136-0cd0-4277-a505-fdf84a7c1619),volume_type_id=fb114136-0cd0-4277-a505-fdf84a7c1619)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Creating volume d20dd840-1620-4757-b659-8435a9cac3dd {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:36:33 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d20dd840-1620-4757-b659-8435a9cac3dd 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:33 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d20dd840-1620-4757-b659-8435a9cac3dd 1073741824 Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-eb32cf30-1c2b-4564-b9c1-5a14929e5a0b tempest-VolumesListTestJSON-809862365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-eb32cf30-1c2b-4564-b9c1-5a14929e5a0b tempest-VolumesListTestJSON-809862365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-eb32cf30-1c2b-4564-b9c1-5a14929e5a0b tempest-VolumesListTestJSON-809862365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:33 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-eb32cf30-1c2b-4564-b9c1-5a14929e5a0b tempest-VolumesListTestJSON-809862365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-eb32cf30-1c2b-4564-b9c1-5a14929e5a0b tempest-VolumesListTestJSON-809862365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-eb32cf30-1c2b-4564-b9c1-5a14929e5a0b tempest-VolumesListTestJSON-809862365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:33 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:36:33 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:33 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-eb32cf30-1c2b-4564-b9c1-5a14929e5a0b tempest-VolumesListTestJSON-809862365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.492s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-eb32cf30-1c2b-4564-b9c1-5a14929e5a0b tempest-VolumesListTestJSON-809862365 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:36:33 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-eb32cf30-1c2b-4564-b9c1-5a14929e5a0b tempest-VolumesListTestJSON-809862365 None] Deleted volume successfully. Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e58dcfb5-8f1a-428f-b635-6d01233cc5a3 tempest-VolumesListTestJSON-809862365 None] Acquiring lock "cinder-8814aeca-76db-40dd-99b5-39ab69eb7af9-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-eb32cf30-1c2b-4564-b9c1-5a14929e5a0b tempest-VolumesListTestJSON-809862365 None] Lock "cinder-cc4cd3ed-61ab-492e-9645-baaae40fb0f8-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e58dcfb5-8f1a-428f-b635-6d01233cc5a3 tempest-VolumesListTestJSON-809862365 None] Lock "cinder-8814aeca-76db-40dd-99b5-39ab69eb7af9-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e58dcfb5-8f1a-428f-b635-6d01233cc5a3 tempest-VolumesListTestJSON-809862365 None] Acquiring lock "cinder-quobyte-8814aeca-76db-40dd-99b5-39ab69eb7af9" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e58dcfb5-8f1a-428f-b635-6d01233cc5a3 tempest-VolumesListTestJSON-809862365 None] Lock "cinder-quobyte-8814aeca-76db-40dd-99b5-39ab69eb7af9" acquired by "delete_volume" :: waited 0.038s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:34 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5201e4-bbea-4917-b860-daa31aa67e9a]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e58dcfb5-8f1a-428f-b635-6d01233cc5a3 tempest-VolumesListTestJSON-809862365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8814aeca-76db-40dd-99b5-39ab69eb7af9 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:34 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d20dd840-1620-4757-b659-8435a9cac3dd 1073741824" returned: 0 in 1.035s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d20dd840-1620-4757-b659-8435a9cac3dd {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:34 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8814aeca-76db-40dd-99b5-39ab69eb7af9 Nov 03 07:36:34 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:34 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d20dd840-1620-4757-b659-8435a9cac3dd Nov 03 07:36:34 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:34 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e58dcfb5-8f1a-428f-b635-6d01233cc5a3 tempest-VolumesListTestJSON-809862365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8814aeca-76db-40dd-99b5-39ab69eb7af9" returned: 0 in 0.535s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e58dcfb5-8f1a-428f-b635-6d01233cc5a3 tempest-VolumesListTestJSON-809862365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8814aeca-76db-40dd-99b5-39ab69eb7af9 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:34 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d20dd840-1620-4757-b659-8435a9cac3dd" returned: 0 in 0.411s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:36:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:34 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8814aeca-76db-40dd-99b5-39ab69eb7af9 Nov 03 07:36:34 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be60b43-369c-4479-9b15-db3780d03f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d20dd840-1620-4757-b659-8435a9cac3dd', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b44b515-e8e1-44e3-92f6-f099ff636c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:34 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Volume volume-d20dd840-1620-4757-b659-8435a9cac3dd (d20dd840-1620-4757-b659-8435a9cac3dd): created successfully Nov 03 07:36:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b44b515-e8e1-44e3-92f6-f099ff636c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Flow 'volume_create_manager' (b90a24a8-0876-4441-bb9e-a065cd27659f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:34 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-1fa7dad8-9871-4b3a-9794-f4abeb57bf71 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Created volume successfully. Nov 03 07:36:35 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e58dcfb5-8f1a-428f-b635-6d01233cc5a3 tempest-VolumesListTestJSON-809862365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8814aeca-76db-40dd-99b5-39ab69eb7af9" returned: 0 in 0.324s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e58dcfb5-8f1a-428f-b635-6d01233cc5a3 tempest-VolumesListTestJSON-809862365 None] Lock "cinder-quobyte-8814aeca-76db-40dd-99b5-39ab69eb7af9" released by "delete_volume" :: held 0.949s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:35 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-e58dcfb5-8f1a-428f-b635-6d01233cc5a3 tempest-VolumesListTestJSON-809862365 None] Created reservations ['9730001f-193b-4008-b762-1b27c09f895f', '6144f6b7-5324-44ba-87fb-1d1bf70f715a', '2edef0fe-05a8-412c-8438-01a1848733ad', 'c6ad7cc6-edaf-4429-84ef-2009ec006708'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:36:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e58dcfb5-8f1a-428f-b635-6d01233cc5a3 tempest-VolumesListTestJSON-809862365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e58dcfb5-8f1a-428f-b635-6d01233cc5a3 tempest-VolumesListTestJSON-809862365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e58dcfb5-8f1a-428f-b635-6d01233cc5a3 tempest-VolumesListTestJSON-809862365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e58dcfb5-8f1a-428f-b635-6d01233cc5a3 tempest-VolumesListTestJSON-809862365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e58dcfb5-8f1a-428f-b635-6d01233cc5a3 tempest-VolumesListTestJSON-809862365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e58dcfb5-8f1a-428f-b635-6d01233cc5a3 tempest-VolumesListTestJSON-809862365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:35 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:36:35 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:35 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e58dcfb5-8f1a-428f-b635-6d01233cc5a3 tempest-VolumesListTestJSON-809862365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.452s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:35 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-e58dcfb5-8f1a-428f-b635-6d01233cc5a3 tempest-VolumesListTestJSON-809862365 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:36:35 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-e58dcfb5-8f1a-428f-b635-6d01233cc5a3 tempest-VolumesListTestJSON-809862365 None] Deleted volume successfully. Nov 03 07:36:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e58dcfb5-8f1a-428f-b635-6d01233cc5a3 tempest-VolumesListTestJSON-809862365 None] Lock "cinder-8814aeca-76db-40dd-99b5-39ab69eb7af9-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-bf2585b1-be21-4f0f-8351-96a891d231c8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-bf2585b1-be21-4f0f-8351-96a891d231c8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-bf2585b1-be21-4f0f-8351-96a891d231c8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-bf2585b1-be21-4f0f-8351-96a891d231c8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-bf2585b1-be21-4f0f-8351-96a891d231c8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bf2585b1-be21-4f0f-8351-96a891d231c8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:36 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:36:36 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:36 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bf2585b1-be21-4f0f-8351-96a891d231c8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.308s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:36 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-bf2585b1-be21-4f0f-8351-96a891d231c8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:36:36 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-bf2585b1-be21-4f0f-8351-96a891d231c8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Retype volume completed successfully. Nov 03 07:36:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ba3b84f9-c668-4837-9573-d6e81e56b8be tempest-VolumesListTestJSON-809862365 None] Acquiring lock "cinder-a74ae067-aee5-40f3-a1ef-42bdbd825ac2-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ba3b84f9-c668-4837-9573-d6e81e56b8be tempest-VolumesListTestJSON-809862365 None] Lock "cinder-a74ae067-aee5-40f3-a1ef-42bdbd825ac2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ba3b84f9-c668-4837-9573-d6e81e56b8be tempest-VolumesListTestJSON-809862365 None] Acquiring lock "cinder-quobyte-a74ae067-aee5-40f3-a1ef-42bdbd825ac2" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ba3b84f9-c668-4837-9573-d6e81e56b8be tempest-VolumesListTestJSON-809862365 None] Lock "cinder-quobyte-a74ae067-aee5-40f3-a1ef-42bdbd825ac2" acquired by "delete_volume" :: waited 0.020s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:36 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da770a6-9ad1-4859-acfa-0e9744a887b1]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ba3b84f9-c668-4837-9573-d6e81e56b8be tempest-VolumesListTestJSON-809862365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a74ae067-aee5-40f3-a1ef-42bdbd825ac2 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:36 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a74ae067-aee5-40f3-a1ef-42bdbd825ac2 Nov 03 07:36:36 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:37 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ba3b84f9-c668-4837-9573-d6e81e56b8be tempest-VolumesListTestJSON-809862365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a74ae067-aee5-40f3-a1ef-42bdbd825ac2" returned: 0 in 0.445s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ba3b84f9-c668-4837-9573-d6e81e56b8be tempest-VolumesListTestJSON-809862365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a74ae067-aee5-40f3-a1ef-42bdbd825ac2 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:37 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a74ae067-aee5-40f3-a1ef-42bdbd825ac2 Nov 03 07:36:37 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0c8024d0-6399-485b-b381-ce30809da4f8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Acquiring lock "cinder-d20dd840-1620-4757-b659-8435a9cac3dd-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0c8024d0-6399-485b-b381-ce30809da4f8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Lock "cinder-d20dd840-1620-4757-b659-8435a9cac3dd-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0c8024d0-6399-485b-b381-ce30809da4f8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Acquiring lock "cinder-quobyte-d20dd840-1620-4757-b659-8435a9cac3dd" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0c8024d0-6399-485b-b381-ce30809da4f8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Lock "cinder-quobyte-d20dd840-1620-4757-b659-8435a9cac3dd" acquired by "delete_volume" :: waited 0.035s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:37 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ba3b84f9-c668-4837-9573-d6e81e56b8be tempest-VolumesListTestJSON-809862365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a74ae067-aee5-40f3-a1ef-42bdbd825ac2" returned: 0 in 0.430s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:37 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1629e4c-5668-4543-886e-04d72bb9ea9a]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0c8024d0-6399-485b-b381-ce30809da4f8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d20dd840-1620-4757-b659-8435a9cac3dd {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ba3b84f9-c668-4837-9573-d6e81e56b8be tempest-VolumesListTestJSON-809862365 None] Lock "cinder-quobyte-a74ae067-aee5-40f3-a1ef-42bdbd825ac2" released by "delete_volume" :: held 0.949s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:37 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-ba3b84f9-c668-4837-9573-d6e81e56b8be tempest-VolumesListTestJSON-809862365 None] Created reservations ['ff3227ab-7d79-4f15-a77f-39a21635713e', 'abe21463-e292-4e3c-b506-a2819eb57302', '7af04f49-189f-4b4f-ad46-6adbe60d17d8', 'fb039f66-4ae2-4f19-94fc-2edf92d52ec1'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:36:37 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d20dd840-1620-4757-b659-8435a9cac3dd Nov 03 07:36:37 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ba3b84f9-c668-4837-9573-d6e81e56b8be tempest-VolumesListTestJSON-809862365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ba3b84f9-c668-4837-9573-d6e81e56b8be tempest-VolumesListTestJSON-809862365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:37 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ba3b84f9-c668-4837-9573-d6e81e56b8be tempest-VolumesListTestJSON-809862365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:37 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ba3b84f9-c668-4837-9573-d6e81e56b8be tempest-VolumesListTestJSON-809862365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ba3b84f9-c668-4837-9573-d6e81e56b8be tempest-VolumesListTestJSON-809862365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ba3b84f9-c668-4837-9573-d6e81e56b8be tempest-VolumesListTestJSON-809862365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:37 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:36:37 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:38 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0c8024d0-6399-485b-b381-ce30809da4f8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d20dd840-1620-4757-b659-8435a9cac3dd" returned: 0 in 0.539s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0c8024d0-6399-485b-b381-ce30809da4f8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d20dd840-1620-4757-b659-8435a9cac3dd {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:38 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ba3b84f9-c668-4837-9573-d6e81e56b8be tempest-VolumesListTestJSON-809862365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.332s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:38 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-ba3b84f9-c668-4837-9573-d6e81e56b8be tempest-VolumesListTestJSON-809862365 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:36:38 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d20dd840-1620-4757-b659-8435a9cac3dd Nov 03 07:36:38 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:38 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ba3b84f9-c668-4837-9573-d6e81e56b8be tempest-VolumesListTestJSON-809862365 None] Deleted volume successfully. Nov 03 07:36:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ba3b84f9-c668-4837-9573-d6e81e56b8be tempest-VolumesListTestJSON-809862365 None] Lock "cinder-a74ae067-aee5-40f3-a1ef-42bdbd825ac2-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:38 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0c8024d0-6399-485b-b381-ce30809da4f8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d20dd840-1620-4757-b659-8435a9cac3dd" returned: 0 in 0.303s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0c8024d0-6399-485b-b381-ce30809da4f8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Lock "cinder-quobyte-d20dd840-1620-4757-b659-8435a9cac3dd" released by "delete_volume" :: held 0.914s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:38 devstack cinder-volume[87016]: WARNING cinder.quota [None req-0c8024d0-6399-485b-b381-ce30809da4f8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:36:38 devstack cinder-volume[87016]: WARNING cinder.quota [None req-0c8024d0-6399-485b-b381-ce30809da4f8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:36:38 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-0c8024d0-6399-485b-b381-ce30809da4f8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Created reservations ['7c74fee5-618e-4eaa-a6ff-f121d9347f90', 'aacec34e-6e39-43ee-9d6c-8b243ad571f8', 'fe5f7041-aeea-4cd8-bb4c-d5d8fef618b9', '4ea83559-dae3-4eaa-b635-6f1b60b7bde4'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:36:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0c8024d0-6399-485b-b381-ce30809da4f8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0c8024d0-6399-485b-b381-ce30809da4f8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:38 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0c8024d0-6399-485b-b381-ce30809da4f8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:38 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0c8024d0-6399-485b-b381-ce30809da4f8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0c8024d0-6399-485b-b381-ce30809da4f8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0c8024d0-6399-485b-b381-ce30809da4f8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:38 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:36:38 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:38 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0c8024d0-6399-485b-b381-ce30809da4f8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.309s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:38 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-0c8024d0-6399-485b-b381-ce30809da4f8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:36:38 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-0c8024d0-6399-485b-b381-ce30809da4f8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Deleted volume successfully. Nov 03 07:36:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0c8024d0-6399-485b-b381-ce30809da4f8 tempest-VolumeRetypeWithoutMigrationTest-1250975544 None] Lock "cinder-d20dd840-1620-4757-b659-8435a9cac3dd-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Flow 'volume_create_manager' (2ee2a808-43e9-40e8-9775-1d4a985cfe12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c943132f-40e3-499e-b3f9-5cb9ad33eda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c943132f-40e3-499e-b3f9-5cb9ad33eda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-844727179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f3d23b7-73fe-4274-899f-9a8272a44bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c8cb46056944aaea3232efe51016f0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:44Z,use_quota=True,user_id='6773873d86fb4e53b1c79fb33f128231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d583f75-e948-445e-b7b4-41b967eed420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d583f75-e948-445e-b7b4-41b967eed420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb4d54a-2258-4bd3-a91f-6bbe78bc626a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb4d54a-2258-4bd3-a91f-6bbe78bc626a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f3d23b7-73fe-4274-899f-9a8272a44bde', 'volume_name': 'volume-8f3d23b7-73fe-4274-899f-9a8272a44bde', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e956a0-2827-42b9-9faf-a8a16721d403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e956a0-2827-42b9-9faf-a8a16721d403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b9e0ce-6e76-4503-9dd0-6a8e7964b6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:44 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Volume 8f3d23b7-73fe-4274-899f-9a8272a44bde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f3d23b7-73fe-4274-899f-9a8272a44bde', 'volume_size': 1} Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-844727179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f3d23b7-73fe-4274-899f-9a8272a44bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c8cb46056944aaea3232efe51016f0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:44Z,use_quota=True,user_id='6773873d86fb4e53b1c79fb33f128231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Creating volume 8f3d23b7-73fe-4274-899f-9a8272a44bde {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:36:44 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8f3d23b7-73fe-4274-899f-9a8272a44bde 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:44 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8f3d23b7-73fe-4274-899f-9a8272a44bde 1073741824 Nov 03 07:36:44 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:44 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8f3d23b7-73fe-4274-899f-9a8272a44bde 1073741824" returned: 0 in 0.523s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8f3d23b7-73fe-4274-899f-9a8272a44bde {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:44 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8f3d23b7-73fe-4274-899f-9a8272a44bde Nov 03 07:36:44 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:45 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8f3d23b7-73fe-4274-899f-9a8272a44bde" returned: 0 in 0.317s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:45 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:36:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b9e0ce-6e76-4503-9dd0-6a8e7964b6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f3d23b7-73fe-4274-899f-9a8272a44bde', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d8f50d-f395-462b-86bc-95a048f8d482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:45 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Volume volume-8f3d23b7-73fe-4274-899f-9a8272a44bde (8f3d23b7-73fe-4274-899f-9a8272a44bde): created successfully Nov 03 07:36:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d8f50d-f395-462b-86bc-95a048f8d482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Flow 'volume_create_manager' (2ee2a808-43e9-40e8-9775-1d4a985cfe12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:45 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-869cdb90-9681-4c1a-9809-f3d7222594ef tempest-VolumesNegativeTest-1755131394 None] Created volume successfully. Nov 03 07:36:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:36:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:49 devstack sudo[100646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:36:49 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:49 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.555s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:36:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:36:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 28 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:36:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=67,cinder:UPDATE=87,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=72,cinder:UPDATE=89,cinder:INSERT=14,cinder:DELETE=7 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Flow 'volume_create_manager' (a5282c2e-d556-422e-945e-033e8a0a093f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d1ddae-3d02-4890-9d69-5844d60d957f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d1ddae-3d02-4890-9d69-5844d60d957f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1105543050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0df6ef-9be8-40db-a8f0-322b1591ba8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae3776f064cb43c2b44e2b3e4c6cf24b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:53Z,use_quota=True,user_id='1574ee438fe449c49434fdf3410557a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744d8dee-754e-4400-9bdb-cf7341085733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744d8dee-754e-4400-9bdb-cf7341085733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4cdc5cc-daea-47c9-a3df-bea12c5c18c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4cdc5cc-daea-47c9-a3df-bea12c5c18c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da0df6ef-9be8-40db-a8f0-322b1591ba8d', 'volume_name': 'volume-da0df6ef-9be8-40db-a8f0-322b1591ba8d', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec95a46-2186-44c3-bdac-5fa4435095b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec95a46-2186-44c3-bdac-5fa4435095b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6173a829-cff3-4741-8435-acb7e1424f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:53 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Volume da0df6ef-9be8-40db-a8f0-322b1591ba8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da0df6ef-9be8-40db-a8f0-322b1591ba8d', 'volume_size': 1} Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1105543050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0df6ef-9be8-40db-a8f0-322b1591ba8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae3776f064cb43c2b44e2b3e4c6cf24b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:53Z,use_quota=True,user_id='1574ee438fe449c49434fdf3410557a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Creating volume da0df6ef-9be8-40db-a8f0-322b1591ba8d {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:36:53 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:36:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-da0df6ef-9be8-40db-a8f0-322b1591ba8d 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:53 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-da0df6ef-9be8-40db-a8f0-322b1591ba8d 1073741824 Nov 03 07:36:53 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:54 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-da0df6ef-9be8-40db-a8f0-322b1591ba8d 1073741824" returned: 0 in 0.871s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-da0df6ef-9be8-40db-a8f0-322b1591ba8d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:54 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-da0df6ef-9be8-40db-a8f0-322b1591ba8d Nov 03 07:36:54 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:55 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-da0df6ef-9be8-40db-a8f0-322b1591ba8d" returned: 0 in 0.686s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:55 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:36:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6173a829-cff3-4741-8435-acb7e1424f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da0df6ef-9be8-40db-a8f0-322b1591ba8d', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c9a525-7353-4f96-8e24-657e079763f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:55 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Volume volume-da0df6ef-9be8-40db-a8f0-322b1591ba8d (da0df6ef-9be8-40db-a8f0-322b1591ba8d): created successfully Nov 03 07:36:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c9a525-7353-4f96-8e24-657e079763f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Flow 'volume_create_manager' (a5282c2e-d556-422e-945e-033e8a0a093f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:55 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-33b1fa45-eaab-4f14-9349-3c1b17526158 tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Created volume successfully. Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-61eff056-5c01-47d8-bcc9-15f0cb92caa0 req-46081b0b-6636-4804-9bc6-6c583971c47f tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-61eff056-5c01-47d8-bcc9-15f0cb92caa0 req-46081b0b-6636-4804-9bc6-6c583971c47f tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-61eff056-5c01-47d8-bcc9-15f0cb92caa0 req-46081b0b-6636-4804-9bc6-6c583971c47f tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-61eff056-5c01-47d8-bcc9-15f0cb92caa0 req-46081b0b-6636-4804-9bc6-6c583971c47f tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14', 'name': 'volume-da0df6ef-9be8-40db-a8f0-322b1591ba8d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93356e56-7fbf-478c-bdbb-f87a160640c0', 'enforce_multipath': True} {{(pid=87016) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:36:58 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-61eff056-5c01-47d8-bcc9-15f0cb92caa0 req-46081b0b-6636-4804-9bc6-6c583971c47f tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] attachment_update completed successfully. Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Flow 'volume_create_manager' (2212a127-664e-498f-b508-1af19f6cbeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a803da0f-b884-444f-9cc1-f15ad96d6c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a803da0f-b884-444f-9cc1-f15ad96d6c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1889662240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1f72a31-11a4-4644-8072-74b9a1cf06f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5ecae3cc26a41e0bc21bf4948c5d892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:59Z,use_quota=True,user_id='b3a95b0fc7fa465695b4b36982fa358e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(117e9f3a-b3e3-4de5-b58c-8742e79241fd),volume_type_id=117e9f3a-b3e3-4de5-b58c-8742e79241fd)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e97b29d-f12e-4b01-9d13-9c89c8e83d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e97b29d-f12e-4b01-9d13-9c89c8e83d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ffc4149-e551-4347-bf73-98ed551ac5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ffc4149-e551-4347-bf73-98ed551ac5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1f72a31-11a4-4644-8072-74b9a1cf06f8', 'volume_name': 'volume-c1f72a31-11a4-4644-8072-74b9a1cf06f8', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6225214e-ca3e-4c5f-8337-01a9c606c250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6225214e-ca3e-4c5f-8337-01a9c606c250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3277af-9815-4c35-9506-c37f3e2916ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:58 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Volume c1f72a31-11a4-4644-8072-74b9a1cf06f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1f72a31-11a4-4644-8072-74b9a1cf06f8', 'volume_size': 1} Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1889662240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1f72a31-11a4-4644-8072-74b9a1cf06f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5ecae3cc26a41e0bc21bf4948c5d892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:59Z,use_quota=True,user_id='b3a95b0fc7fa465695b4b36982fa358e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(117e9f3a-b3e3-4de5-b58c-8742e79241fd),volume_type_id=117e9f3a-b3e3-4de5-b58c-8742e79241fd)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Creating volume c1f72a31-11a4-4644-8072-74b9a1cf06f8 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:36:58 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:36:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1f72a31-11a4-4644-8072-74b9a1cf06f8 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:59 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1f72a31-11a4-4644-8072-74b9a1cf06f8 1073741824 Nov 03 07:36:59 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:59 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1f72a31-11a4-4644-8072-74b9a1cf06f8 1073741824" returned: 0 in 0.756s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1f72a31-11a4-4644-8072-74b9a1cf06f8 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:59 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1f72a31-11a4-4644-8072-74b9a1cf06f8 Nov 03 07:36:59 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:00 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1f72a31-11a4-4644-8072-74b9a1cf06f8" returned: 0 in 0.474s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:37:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:00 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3277af-9815-4c35-9506-c37f3e2916ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1f72a31-11a4-4644-8072-74b9a1cf06f8', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:00 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c868a8cb-5db9-4e33-9406-88e26bc222e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:00 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Volume volume-c1f72a31-11a4-4644-8072-74b9a1cf06f8 (c1f72a31-11a4-4644-8072-74b9a1cf06f8): created successfully Nov 03 07:37:00 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c868a8cb-5db9-4e33-9406-88e26bc222e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:00 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Flow 'volume_create_manager' (2212a127-664e-498f-b508-1af19f6cbeb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:00 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-83d9a341-0d32-4166-9f19-637f90763785 tempest-VolumeTypesAccessTest-1567513685 None] Created volume successfully. Nov 03 07:37:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-50677c64-5086-4633-86bd-46a955b331fb tempest-VolumeTypesAccessTest-1567513685 None] Acquiring lock "cinder-c1f72a31-11a4-4644-8072-74b9a1cf06f8-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-50677c64-5086-4633-86bd-46a955b331fb tempest-VolumeTypesAccessTest-1567513685 None] Lock "cinder-c1f72a31-11a4-4644-8072-74b9a1cf06f8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-50677c64-5086-4633-86bd-46a955b331fb tempest-VolumeTypesAccessTest-1567513685 None] Acquiring lock "cinder-quobyte-c1f72a31-11a4-4644-8072-74b9a1cf06f8" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-50677c64-5086-4633-86bd-46a955b331fb tempest-VolumeTypesAccessTest-1567513685 None] Lock "cinder-quobyte-c1f72a31-11a4-4644-8072-74b9a1cf06f8" acquired by "delete_volume" :: waited 0.045s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:01 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[5182330c-226f-4001-a4b8-a115efa120b2]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-50677c64-5086-4633-86bd-46a955b331fb tempest-VolumeTypesAccessTest-1567513685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1f72a31-11a4-4644-8072-74b9a1cf06f8 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:01 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1f72a31-11a4-4644-8072-74b9a1cf06f8 Nov 03 07:37:01 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:01 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-50677c64-5086-4633-86bd-46a955b331fb tempest-VolumeTypesAccessTest-1567513685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1f72a31-11a4-4644-8072-74b9a1cf06f8" returned: 0 in 0.662s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-50677c64-5086-4633-86bd-46a955b331fb tempest-VolumeTypesAccessTest-1567513685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1f72a31-11a4-4644-8072-74b9a1cf06f8 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:01 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1f72a31-11a4-4644-8072-74b9a1cf06f8 Nov 03 07:37:01 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:02 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-50677c64-5086-4633-86bd-46a955b331fb tempest-VolumeTypesAccessTest-1567513685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1f72a31-11a4-4644-8072-74b9a1cf06f8" returned: 0 in 0.414s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:02 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-50677c64-5086-4633-86bd-46a955b331fb tempest-VolumeTypesAccessTest-1567513685 None] Lock "cinder-quobyte-c1f72a31-11a4-4644-8072-74b9a1cf06f8" released by "delete_volume" :: held 1.185s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:02 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-320f2103-e8cc-4460-ac07-0ffc5ef7351c req-96b6f8b2-0dc6-4ff4-ab23-a5c32b9847dd tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Terminate volume connection completed successfully. Nov 03 07:37:02 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-320f2103-e8cc-4460-ac07-0ffc5ef7351c req-96b6f8b2-0dc6-4ff4-ab23-a5c32b9847dd tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Deleting attachment 93356e56-7fbf-478c-bdbb-f87a160640c0. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:37:02 devstack cinder-volume[87016]: WARNING cinder.quota [None req-50677c64-5086-4633-86bd-46a955b331fb tempest-VolumeTypesAccessTest-1567513685 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-536254308 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-536254308, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:37:02 devstack cinder-volume[87016]: WARNING cinder.quota [None req-50677c64-5086-4633-86bd-46a955b331fb tempest-VolumeTypesAccessTest-1567513685 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-536254308 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-536254308, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:37:02 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-50677c64-5086-4633-86bd-46a955b331fb tempest-VolumeTypesAccessTest-1567513685 None] Created reservations ['b251d735-9a47-40af-bee0-f7fa38d03038', 'fc6aeb25-ff8f-4167-af3f-49a2d5bfb83d', 'b722bee1-1d3d-4f32-82e8-efd4bb48e667', '888096d5-bda2-499c-984b-0434a41f7439'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:37:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-50677c64-5086-4633-86bd-46a955b331fb tempest-VolumeTypesAccessTest-1567513685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-50677c64-5086-4633-86bd-46a955b331fb tempest-VolumeTypesAccessTest-1567513685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:02 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-50677c64-5086-4633-86bd-46a955b331fb tempest-VolumeTypesAccessTest-1567513685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:02 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-50677c64-5086-4633-86bd-46a955b331fb tempest-VolumeTypesAccessTest-1567513685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-50677c64-5086-4633-86bd-46a955b331fb tempest-VolumeTypesAccessTest-1567513685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-50677c64-5086-4633-86bd-46a955b331fb tempest-VolumeTypesAccessTest-1567513685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:02 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:37:02 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:02 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-50677c64-5086-4633-86bd-46a955b331fb tempest-VolumeTypesAccessTest-1567513685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.316s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:02 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-50677c64-5086-4633-86bd-46a955b331fb tempest-VolumeTypesAccessTest-1567513685 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:37:02 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-50677c64-5086-4633-86bd-46a955b331fb tempest-VolumeTypesAccessTest-1567513685 None] Deleted volume successfully. Nov 03 07:37:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-50677c64-5086-4633-86bd-46a955b331fb tempest-VolumeTypesAccessTest-1567513685 None] Lock "cinder-c1f72a31-11a4-4644-8072-74b9a1cf06f8-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0bed1f7b-3323-46dc-8af5-9a96e844a4fe tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Acquiring lock "cinder-da0df6ef-9be8-40db-a8f0-322b1591ba8d-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0bed1f7b-3323-46dc-8af5-9a96e844a4fe tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Lock "cinder-da0df6ef-9be8-40db-a8f0-322b1591ba8d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0bed1f7b-3323-46dc-8af5-9a96e844a4fe tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Acquiring lock "cinder-quobyte-da0df6ef-9be8-40db-a8f0-322b1591ba8d" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0bed1f7b-3323-46dc-8af5-9a96e844a4fe tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Lock "cinder-quobyte-da0df6ef-9be8-40db-a8f0-322b1591ba8d" acquired by "delete_volume" :: waited 0.024s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:03 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[0888db83-1342-455a-a1f5-be7d5c59876c]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0bed1f7b-3323-46dc-8af5-9a96e844a4fe tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-da0df6ef-9be8-40db-a8f0-322b1591ba8d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:03 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-da0df6ef-9be8-40db-a8f0-322b1591ba8d Nov 03 07:37:03 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:03 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0bed1f7b-3323-46dc-8af5-9a96e844a4fe tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-da0df6ef-9be8-40db-a8f0-322b1591ba8d" returned: 0 in 0.588s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0bed1f7b-3323-46dc-8af5-9a96e844a4fe tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-da0df6ef-9be8-40db-a8f0-322b1591ba8d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:03 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-da0df6ef-9be8-40db-a8f0-322b1591ba8d Nov 03 07:37:03 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:04 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0bed1f7b-3323-46dc-8af5-9a96e844a4fe tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-da0df6ef-9be8-40db-a8f0-322b1591ba8d" returned: 0 in 0.344s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0bed1f7b-3323-46dc-8af5-9a96e844a4fe tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Lock "cinder-quobyte-da0df6ef-9be8-40db-a8f0-322b1591ba8d" released by "delete_volume" :: held 0.999s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:04 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-0bed1f7b-3323-46dc-8af5-9a96e844a4fe tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Created reservations ['3eebe926-0ffc-42af-87b6-1f1d626848d3', 'cd313523-eb24-48e8-b79e-32a782b58ca0', '7fcc5d9b-95c9-457f-8439-bd133e073be4', '5a91b696-6225-4212-b897-90676d5288a9'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:37:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0bed1f7b-3323-46dc-8af5-9a96e844a4fe tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0bed1f7b-3323-46dc-8af5-9a96e844a4fe tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:04 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0bed1f7b-3323-46dc-8af5-9a96e844a4fe tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:04 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0bed1f7b-3323-46dc-8af5-9a96e844a4fe tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0bed1f7b-3323-46dc-8af5-9a96e844a4fe tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0bed1f7b-3323-46dc-8af5-9a96e844a4fe tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:04 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:37:04 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:04 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0bed1f7b-3323-46dc-8af5-9a96e844a4fe tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.295s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:04 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-0bed1f7b-3323-46dc-8af5-9a96e844a4fe tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:37:04 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-0bed1f7b-3323-46dc-8af5-9a96e844a4fe tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Deleted volume successfully. Nov 03 07:37:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0bed1f7b-3323-46dc-8af5-9a96e844a4fe tempest-TestServerVolumeAttachScenarioOldVersion-836317444 None] Lock "cinder-da0df6ef-9be8-40db-a8f0-322b1591ba8d-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5b005a39-fd48-4f6e-81a6-b054d7fc1bec tempest-VolumesNegativeTest-1755131394 None] Acquiring lock "cinder-8f3d23b7-73fe-4274-899f-9a8272a44bde-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5b005a39-fd48-4f6e-81a6-b054d7fc1bec tempest-VolumesNegativeTest-1755131394 None] Lock "cinder-8f3d23b7-73fe-4274-899f-9a8272a44bde-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5b005a39-fd48-4f6e-81a6-b054d7fc1bec tempest-VolumesNegativeTest-1755131394 None] Acquiring lock "cinder-quobyte-8f3d23b7-73fe-4274-899f-9a8272a44bde" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5b005a39-fd48-4f6e-81a6-b054d7fc1bec tempest-VolumesNegativeTest-1755131394 None] Lock "cinder-quobyte-8f3d23b7-73fe-4274-899f-9a8272a44bde" acquired by "delete_volume" :: waited 0.019s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:12 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f16f595-6693-484b-8a5c-ec65a8999381]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5b005a39-fd48-4f6e-81a6-b054d7fc1bec tempest-VolumesNegativeTest-1755131394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8f3d23b7-73fe-4274-899f-9a8272a44bde {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:12 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8f3d23b7-73fe-4274-899f-9a8272a44bde Nov 03 07:37:12 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:13 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5b005a39-fd48-4f6e-81a6-b054d7fc1bec tempest-VolumesNegativeTest-1755131394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8f3d23b7-73fe-4274-899f-9a8272a44bde" returned: 0 in 0.542s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5b005a39-fd48-4f6e-81a6-b054d7fc1bec tempest-VolumesNegativeTest-1755131394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8f3d23b7-73fe-4274-899f-9a8272a44bde {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:13 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8f3d23b7-73fe-4274-899f-9a8272a44bde Nov 03 07:37:13 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:13 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5b005a39-fd48-4f6e-81a6-b054d7fc1bec tempest-VolumesNegativeTest-1755131394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8f3d23b7-73fe-4274-899f-9a8272a44bde" returned: 0 in 0.353s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5b005a39-fd48-4f6e-81a6-b054d7fc1bec tempest-VolumesNegativeTest-1755131394 None] Lock "cinder-quobyte-8f3d23b7-73fe-4274-899f-9a8272a44bde" released by "delete_volume" :: held 1.003s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:13 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-5b005a39-fd48-4f6e-81a6-b054d7fc1bec tempest-VolumesNegativeTest-1755131394 None] Created reservations ['66ef4920-ad6e-42b8-b58b-0566da25de2f', 'e78beae6-71ee-4548-bf2d-adca8a8da36b', '797fec32-9dd6-4a67-8af0-9801f400bd89', '994af14d-6803-43a7-9870-33f90f58187c'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:37:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5b005a39-fd48-4f6e-81a6-b054d7fc1bec tempest-VolumesNegativeTest-1755131394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5b005a39-fd48-4f6e-81a6-b054d7fc1bec tempest-VolumesNegativeTest-1755131394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5b005a39-fd48-4f6e-81a6-b054d7fc1bec tempest-VolumesNegativeTest-1755131394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5b005a39-fd48-4f6e-81a6-b054d7fc1bec tempest-VolumesNegativeTest-1755131394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5b005a39-fd48-4f6e-81a6-b054d7fc1bec tempest-VolumesNegativeTest-1755131394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5b005a39-fd48-4f6e-81a6-b054d7fc1bec tempest-VolumesNegativeTest-1755131394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:13 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:37:13 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:14 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5b005a39-fd48-4f6e-81a6-b054d7fc1bec tempest-VolumesNegativeTest-1755131394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.443s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:14 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-5b005a39-fd48-4f6e-81a6-b054d7fc1bec tempest-VolumesNegativeTest-1755131394 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:37:14 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-5b005a39-fd48-4f6e-81a6-b054d7fc1bec tempest-VolumesNegativeTest-1755131394 None] Deleted volume successfully. Nov 03 07:37:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5b005a39-fd48-4f6e-81a6-b054d7fc1bec tempest-VolumesNegativeTest-1755131394 None] Lock "cinder-8f3d23b7-73fe-4274-899f-9a8272a44bde-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:14 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-178069c2-6fd7-4587-a843-32ffcbc8ab9b req-8aa4a3e4-1bf1-4ebd-8d4c-d4f550e36a7e tempest-TestMinimumBasicScenario-93624314 None] Terminate volume connection completed successfully. Nov 03 07:37:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-178069c2-6fd7-4587-a843-32ffcbc8ab9b req-8aa4a3e4-1bf1-4ebd-8d4c-d4f550e36a7e tempest-TestMinimumBasicScenario-93624314 None] Deleting attachment 17d8ab61-c848-41a7-a4c7-9ada8b869bfa. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:37:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ada1081f-1b9d-4ce2-8462-b1d59e02cb4e tempest-TestMinimumBasicScenario-93624314 None] Acquiring lock "cinder-50873719-cb82-40ea-9942-091e202032da-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ada1081f-1b9d-4ce2-8462-b1d59e02cb4e tempest-TestMinimumBasicScenario-93624314 None] Lock "cinder-50873719-cb82-40ea-9942-091e202032da-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ada1081f-1b9d-4ce2-8462-b1d59e02cb4e tempest-TestMinimumBasicScenario-93624314 None] Acquiring lock "cinder-quobyte-50873719-cb82-40ea-9942-091e202032da" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ada1081f-1b9d-4ce2-8462-b1d59e02cb4e tempest-TestMinimumBasicScenario-93624314 None] Lock "cinder-quobyte-50873719-cb82-40ea-9942-091e202032da" acquired by "delete_volume" :: waited 0.015s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:15 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[c393e5c9-d59e-4f77-b938-4d1d5c45766e]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ada1081f-1b9d-4ce2-8462-b1d59e02cb4e tempest-TestMinimumBasicScenario-93624314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50873719-cb82-40ea-9942-091e202032da {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:15 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50873719-cb82-40ea-9942-091e202032da Nov 03 07:37:15 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:16 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ada1081f-1b9d-4ce2-8462-b1d59e02cb4e tempest-TestMinimumBasicScenario-93624314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50873719-cb82-40ea-9942-091e202032da" returned: 0 in 0.611s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ada1081f-1b9d-4ce2-8462-b1d59e02cb4e tempest-TestMinimumBasicScenario-93624314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50873719-cb82-40ea-9942-091e202032da {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:16 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50873719-cb82-40ea-9942-091e202032da Nov 03 07:37:16 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:16 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ada1081f-1b9d-4ce2-8462-b1d59e02cb4e tempest-TestMinimumBasicScenario-93624314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50873719-cb82-40ea-9942-091e202032da" returned: 0 in 0.474s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:16 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ada1081f-1b9d-4ce2-8462-b1d59e02cb4e tempest-TestMinimumBasicScenario-93624314 None] Lock "cinder-quobyte-50873719-cb82-40ea-9942-091e202032da" released by "delete_volume" :: held 1.159s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:16 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-ada1081f-1b9d-4ce2-8462-b1d59e02cb4e tempest-TestMinimumBasicScenario-93624314 None] Created reservations ['bd7e4724-60b4-4b09-b605-199dc1213473', '4cf2e0bd-d02c-401a-9229-edb46917f3e0', '39eccabe-d3fe-449a-96d3-8c8264b7df0f', '5e96818c-26fc-4e16-804d-31bfd3c3b8f7'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:37:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ada1081f-1b9d-4ce2-8462-b1d59e02cb4e tempest-TestMinimumBasicScenario-93624314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ada1081f-1b9d-4ce2-8462-b1d59e02cb4e tempest-TestMinimumBasicScenario-93624314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ada1081f-1b9d-4ce2-8462-b1d59e02cb4e tempest-TestMinimumBasicScenario-93624314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ada1081f-1b9d-4ce2-8462-b1d59e02cb4e tempest-TestMinimumBasicScenario-93624314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ada1081f-1b9d-4ce2-8462-b1d59e02cb4e tempest-TestMinimumBasicScenario-93624314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ada1081f-1b9d-4ce2-8462-b1d59e02cb4e tempest-TestMinimumBasicScenario-93624314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:16 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:37:16 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:17 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ada1081f-1b9d-4ce2-8462-b1d59e02cb4e tempest-TestMinimumBasicScenario-93624314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.368s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:17 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-ada1081f-1b9d-4ce2-8462-b1d59e02cb4e tempest-TestMinimumBasicScenario-93624314 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:37:17 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ada1081f-1b9d-4ce2-8462-b1d59e02cb4e tempest-TestMinimumBasicScenario-93624314 None] Deleted volume successfully. Nov 03 07:37:17 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ada1081f-1b9d-4ce2-8462-b1d59e02cb4e tempest-TestMinimumBasicScenario-93624314 None] Lock "cinder-50873719-cb82-40ea-9942-091e202032da-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:26 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=29,cinder:INSERT=10,cinder:UPDATE=36,cinder:DELETE=3 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:37:27 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=35,cinder:UPDATE=42,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:37:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:37:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:49 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:37:49 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:49 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.332s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:37:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:37:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 28 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:37:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:37:50 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:37:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Flow 'volume_create_manager' (699cd8e5-a91d-4551-823e-e82ba7b6df49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1603d60e-a75e-41b3-ae81-d966c0ba5129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1603d60e-a75e-41b3-ae81-d966c0ba5129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1229422511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882e13f8-0c47-4b53-ab9f-f6a2b38c26e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347aec2ab7f94a1e8d819696f3a0d7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:37:51Z,use_quota=True,user_id='c51619dd5d754839badd2710d23c944c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e805da53-b91d-40f8-bb90-cda8c7ef3aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e805da53-b91d-40f8-bb90-cda8c7ef3aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de76f1f3-a5e2-451a-92b1-108dbdfe001f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de76f1f3-a5e2-451a-92b1-108dbdfe001f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '882e13f8-0c47-4b53-ab9f-f6a2b38c26e4', 'volume_name': 'volume-882e13f8-0c47-4b53-ab9f-f6a2b38c26e4', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac60fe5-3c60-44dc-8b24-00ef768f50ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac60fe5-3c60-44dc-8b24-00ef768f50ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a430c9da-dc2e-4708-8e93-a30163388b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:50 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Volume 882e13f8-0c47-4b53-ab9f-f6a2b38c26e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-882e13f8-0c47-4b53-ab9f-f6a2b38c26e4', 'volume_size': 1} Nov 03 07:37:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1229422511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882e13f8-0c47-4b53-ab9f-f6a2b38c26e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347aec2ab7f94a1e8d819696f3a0d7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:37:51Z,use_quota=True,user_id='c51619dd5d754839badd2710d23c944c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:37:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Creating volume 882e13f8-0c47-4b53-ab9f-f6a2b38c26e4 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:37:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:37:50 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:37:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-882e13f8-0c47-4b53-ab9f-f6a2b38c26e4 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:50 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-882e13f8-0c47-4b53-ab9f-f6a2b38c26e4 1073741824 Nov 03 07:37:50 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:51 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:37:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Flow 'volume_create_manager' (a2f869f7-97ec-49cd-971c-ee785a5688ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65232e8f-f383-4e5a-8f97-f58e5de8b710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65232e8f-f383-4e5a-8f97-f58e5de8b710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-651645105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7f090a-c0de-44b1-9cf8-b819faaff7c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347aec2ab7f94a1e8d819696f3a0d7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:37:51Z,use_quota=True,user_id='c51619dd5d754839badd2710d23c944c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a794aa-9d82-4801-b482-4d147069b64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a794aa-9d82-4801-b482-4d147069b64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb70c98-33a9-4434-9900-d5bfb1bf5557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb70c98-33a9-4434-9900-d5bfb1bf5557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf7f090a-c0de-44b1-9cf8-b819faaff7c9', 'volume_name': 'volume-bf7f090a-c0de-44b1-9cf8-b819faaff7c9', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2418030a-2e71-402f-9e6e-8d2be4089e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2418030a-2e71-402f-9e6e-8d2be4089e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:51 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8832eee-0928-4065-bb83-b061bb3beba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:51 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Volume bf7f090a-c0de-44b1-9cf8-b819faaff7c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf7f090a-c0de-44b1-9cf8-b819faaff7c9', 'volume_size': 1} Nov 03 07:37:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:51 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-882e13f8-0c47-4b53-ab9f-f6a2b38c26e4 1073741824" returned: 0 in 0.846s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-882e13f8-0c47-4b53-ab9f-f6a2b38c26e4 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:51 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-882e13f8-0c47-4b53-ab9f-f6a2b38c26e4 Nov 03 07:37:51 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:52 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-882e13f8-0c47-4b53-ab9f-f6a2b38c26e4" returned: 0 in 0.328s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:37:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.567s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-651645105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7f090a-c0de-44b1-9cf8-b819faaff7c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347aec2ab7f94a1e8d819696f3a0d7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:37:51Z,use_quota=True,user_id='c51619dd5d754839badd2710d23c944c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:37:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Creating volume bf7f090a-c0de-44b1-9cf8-b819faaff7c9 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:37:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:37:52 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:37:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bf7f090a-c0de-44b1-9cf8-b819faaff7c9 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a430c9da-dc2e-4708-8e93-a30163388b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-882e13f8-0c47-4b53-ab9f-f6a2b38c26e4', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:52 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bf7f090a-c0de-44b1-9cf8-b819faaff7c9 1073741824 Nov 03 07:37:52 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7a3f68-c441-4158-9b22-caea3f7c6b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:52 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Volume volume-882e13f8-0c47-4b53-ab9f-f6a2b38c26e4 (882e13f8-0c47-4b53-ab9f-f6a2b38c26e4): created successfully Nov 03 07:37:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7a3f68-c441-4158-9b22-caea3f7c6b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Flow 'volume_create_manager' (699cd8e5-a91d-4551-823e-e82ba7b6df49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:52 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-7060879b-8ba4-455b-a61b-9480f535209e tempest-TestServerVolumeAttachmentScenario-715892166 None] Created volume successfully. Nov 03 07:37:52 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bf7f090a-c0de-44b1-9cf8-b819faaff7c9 1073741824" returned: 0 in 0.663s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bf7f090a-c0de-44b1-9cf8-b819faaff7c9 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:52 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bf7f090a-c0de-44b1-9cf8-b819faaff7c9 Nov 03 07:37:52 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:53 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bf7f090a-c0de-44b1-9cf8-b819faaff7c9" returned: 0 in 0.311s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:37:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8832eee-0928-4065-bb83-b061bb3beba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf7f090a-c0de-44b1-9cf8-b819faaff7c9', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940e6bfd-0469-44f3-8a5e-c1fab111c3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:53 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Volume volume-bf7f090a-c0de-44b1-9cf8-b819faaff7c9 (bf7f090a-c0de-44b1-9cf8-b819faaff7c9): created successfully Nov 03 07:37:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940e6bfd-0469-44f3-8a5e-c1fab111c3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Flow 'volume_create_manager' (a2f869f7-97ec-49cd-971c-ee785a5688ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:53 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-22cb1181-ee43-43a1-a3dd-eea9aa312cbc tempest-TestServerVolumeAttachmentScenario-715892166 None] Created volume successfully. Nov 03 07:38:03 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=3,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:38:03 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:UPDATE=7,cinder:SELECT=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:38:19 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:38:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Flow 'volume_create_manager' (6462413e-c7fa-4258-bc95-fa960670adde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab6da09-db90-47d4-8b1a-c8cf7956bdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab6da09-db90-47d4-8b1a-c8cf7956bdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1927888955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443e8b28-df1d-4aa4-98f1-3688f0009f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0df85ba21a3e449689335e2bc0c05354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:20Z,use_quota=True,user_id='e4f99af5759344e5973867ce8ff47c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae7190f-8198-42bc-b666-24105b0ed8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae7190f-8198-42bc-b666-24105b0ed8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501eb39a-b219-4905-aaf1-cf035c48d19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501eb39a-b219-4905-aaf1-cf035c48d19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '443e8b28-df1d-4aa4-98f1-3688f0009f64', 'volume_name': 'volume-443e8b28-df1d-4aa4-98f1-3688f0009f64', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7791649-6a05-422b-bd29-63d992dc3a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7791649-6a05-422b-bd29-63d992dc3a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc993d4-dc7c-4c29-b3bb-62653fa9f7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:19 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Volume 443e8b28-df1d-4aa4-98f1-3688f0009f64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-443e8b28-df1d-4aa4-98f1-3688f0009f64', 'volume_size': 1} Nov 03 07:38:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1927888955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443e8b28-df1d-4aa4-98f1-3688f0009f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0df85ba21a3e449689335e2bc0c05354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:20Z,use_quota=True,user_id='e4f99af5759344e5973867ce8ff47c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:38:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Creating volume 443e8b28-df1d-4aa4-98f1-3688f0009f64 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:38:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:38:19 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:38:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:19 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64 1073741824 Nov 03 07:38:19 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:20 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64 1073741824" returned: 0 in 0.640s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:20 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64 Nov 03 07:38:20 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:20 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64" returned: 0 in 0.481s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:20 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:38:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc993d4-dc7c-4c29-b3bb-62653fa9f7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-443e8b28-df1d-4aa4-98f1-3688f0009f64', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62fe649d-b037-434f-86b0-bc74892961a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:21 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Volume volume-443e8b28-df1d-4aa4-98f1-3688f0009f64 (443e8b28-df1d-4aa4-98f1-3688f0009f64): created successfully Nov 03 07:38:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62fe649d-b037-434f-86b0-bc74892961a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Flow 'volume_create_manager' (6462413e-c7fa-4258-bc95-fa960670adde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:21 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-5b878f67-8a6d-41d7-8f82-859062fd2745 tempest-TestImageHashVerification-549135150 None] Created volume successfully. Nov 03 07:38:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a8781984-f080-434a-a32f-ad2a21a1f71b tempest-TestImageHashVerification-549135150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a8781984-f080-434a-a32f-ad2a21a1f71b tempest-TestImageHashVerification-549135150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:23 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd5ff2d-bd8c-4d66-b821-a9644d0149e4]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a8781984-f080-434a-a32f-ad2a21a1f71b tempest-TestImageHashVerification-549135150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:23 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64 Nov 03 07:38:23 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:24 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a8781984-f080-434a-a32f-ad2a21a1f71b tempest-TestImageHashVerification-549135150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64" returned: 0 in 0.801s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:24 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7d84cc-0156-4cc1-945a-916787d9fe30]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a8781984-f080-434a-a32f-ad2a21a1f71b tempest-TestImageHashVerification-549135150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:24 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64 Nov 03 07:38:24 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:25 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a8781984-f080-434a-a32f-ad2a21a1f71b tempest-TestImageHashVerification-549135150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64" returned: 0 in 0.967s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a8781984-f080-434a-a32f-ad2a21a1f71b tempest-TestImageHashVerification-549135150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64 /opt/stack/data/cinder/conversion/443e8b28-df1d-4aa4-98f1-3688f0009f64.temp_image.2ce47c57-b08e-4f64-8997-cff4dfcd4b2d23tos9q1.img {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:25 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64 /opt/stack/data/cinder/conversion/443e8b28-df1d-4aa4-98f1-3688f0009f64.temp_image.2ce47c57-b08e-4f64-8997-cff4dfcd4b2d23tos9q1.img Nov 03 07:38:25 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:31 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:38:33 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:38:34 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a8781984-f080-434a-a32f-ad2a21a1f71b tempest-TestImageHashVerification-549135150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64 /opt/stack/data/cinder/conversion/443e8b28-df1d-4aa4-98f1-3688f0009f64.temp_image.2ce47c57-b08e-4f64-8997-cff4dfcd4b2d23tos9q1.img" returned: 0 in 9.438s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:34 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f425bb-2bb9-4ef6-a9a8-5e4421b34c8b]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a8781984-f080-434a-a32f-ad2a21a1f71b tempest-TestImageHashVerification-549135150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:34 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64 Nov 03 07:38:34 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:35 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a8781984-f080-434a-a32f-ad2a21a1f71b tempest-TestImageHashVerification-549135150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64" returned: 0 in 0.729s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:35 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-a8781984-f080-434a-a32f-ad2a21a1f71b tempest-TestImageHashVerification-549135150 None] Image conversion details: src /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64, size 1024.00 MB, duration 9.44 sec, destination /opt/stack/data/cinder/conversion/443e8b28-df1d-4aa4-98f1-3688f0009f64.temp_image.2ce47c57-b08e-4f64-8997-cff4dfcd4b2d23tos9q1.img {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:38:35 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-a8781984-f080-434a-a32f-ad2a21a1f71b tempest-TestImageHashVerification-549135150 None] Converted 1024.00 MB image at 108.48 MB/s Nov 03 07:38:35 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-a8781984-f080-434a-a32f-ad2a21a1f71b tempest-TestImageHashVerification-549135150 None] 2ce47c57-b08e-4f64-8997-cff4dfcd4b2d was raw, no need to convert to raw {{(pid=87016) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 07:38:45 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=1 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:38:45 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=1 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:38:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:38:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:49 devstack sudo[101251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:38:49 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:50 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 1.457s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:50 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:38:50 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:38:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 28 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:38:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:38:52 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:38:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Flow 'volume_create_manager' (bf9f7849-f108-41f7-a8fe-34a1b340cc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63457b31-0b08-4e53-9a05-06416e38343d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63457b31-0b08-4e53-9a05-06416e38343d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-142296659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fabba8dd-848c-4f9a-a45a-5511714ffd87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fe6ab2a64c41d5a7f5b4531a3f185c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:52Z,use_quota=True,user_id='853df9a3be854bbbb11887be438a6033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (732777f1-0086-40cd-b032-45ad207634bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (732777f1-0086-40cd-b032-45ad207634bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d9f8f1-8fb1-40a5-bd75-1f248f12767d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d9f8f1-8fb1-40a5-bd75-1f248f12767d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fabba8dd-848c-4f9a-a45a-5511714ffd87', 'volume_name': 'volume-fabba8dd-848c-4f9a-a45a-5511714ffd87', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9da6d3-4e5c-4f9e-ae11-c1bb9416bf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9da6d3-4e5c-4f9e-ae11-c1bb9416bf86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38a4f50-aa0f-4e16-a901-0880893f536d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:52 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Volume fabba8dd-848c-4f9a-a45a-5511714ffd87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fabba8dd-848c-4f9a-a45a-5511714ffd87', 'volume_size': 1} Nov 03 07:38:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:02 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:UPDATE=1 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:39:02 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=2 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:39:02 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:39:02 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Flow 'volume_create_manager' (f5e8b362-4042-4522-bd81-d6422142e773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:02 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (707511e9-4986-4d48-9563-cf3fa69942f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:02 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (707511e9-4986-4d48-9563-cf3fa69942f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-580543123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca19b950-bc27-4166-8815-5b3c332e269a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe8a6977ed74327801d29c36d5afdb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:03Z,use_quota=True,user_id='10e8734b49934f6ea7b6392127a03f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:02 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edc4c54f-90f3-42a2-bf6a-a85cc71a4472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:02 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edc4c54f-90f3-42a2-bf6a-a85cc71a4472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:02 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8b630f-5102-40f6-bd6e-32d5fc3149bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:02 devstack cinder-volume[87016]: DEBUG cinder.image.glance [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Creating Keystone auth plugin from conf {{(pid=87016) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:39:03 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8b630f-5102-40f6-bd6e-32d5fc3149bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ca19b950-bc27-4166-8815-5b3c332e269a', 'volume_name': 'volume-ca19b950-bc27-4166-8815-5b3c332e269a', 'volume_size': 1, 'image_id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bde64ec799a64fc39c0407ed31a11129', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'created_at': datetime.datetime(2026, 11, 3, 6, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:03 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293983d1-0c99-4310-affd-d15e2feff690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:03 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293983d1-0c99-4310-affd-d15e2feff690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:03 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70649e5c-f2d3-4695-9cc1-7155e096a448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:03 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Volume ca19b950-bc27-4166-8815-5b3c332e269a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ca19b950-bc27-4166-8815-5b3c332e269a', 'volume_size': 1, 'image_id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bde64ec799a64fc39c0407ed31a11129', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'created_at': datetime.datetime(2026, 11, 3, 6, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 07:39:03 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Trying to clone ca19b950-bc27-4166-8815-5b3c332e269a from image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb at location (None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}]). {{(pid=87016) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:39:03 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7el6sea6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:39:03 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Image download 20.69 MB at 20.69 MB/s Nov 03 07:39:03 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f5fada-b377-464a-8c78-5a135d4c9874]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7el6sea6devstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:04 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7el6sea6devstack@QuobyteHD Nov 03 07:39:04 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:04 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7el6sea6devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:04 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Temporary image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb is fetched for user 10e8734b49934f6ea7b6392127a03f5c. {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:39:04 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fa79f4-e61b-4c1c-b50d-010a1d125b98]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7el6sea6devstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:04 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7el6sea6devstack@QuobyteHD Nov 03 07:39:04 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:04 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7el6sea6devstack@QuobyteHD" returned: 0 in 0.463s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-c85076a2-5f33-4a53-b77e-ffd7504756b3 req-5f5faad7-21aa-4cc6-8df3-05d0fdfb5ddf tempest-TestServerVolumeAttachmentScenario-715892166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a8781984-f080-434a-a32f-ad2a21a1f71b tempest-TestImageHashVerification-549135150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 48.085s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a8781984-f080-434a-a32f-ad2a21a1f71b tempest-TestImageHashVerification-549135150 None] Uploaded volume to glance image-id: 2ce47c57-b08e-4f64-8997-cff4dfcd4b2d. {{(pid=87016) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 07:39:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.082s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:11 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-142296659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fabba8dd-848c-4f9a-a45a-5511714ffd87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fe6ab2a64c41d5a7f5b4531a3f185c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:52Z,use_quota=True,user_id='853df9a3be854bbbb11887be438a6033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:39:11 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Creating volume fabba8dd-848c-4f9a-a45a-5511714ffd87 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:39:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:11 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:11 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:11 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:39:11 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:39:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fabba8dd-848c-4f9a-a45a-5511714ffd87 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:11 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fabba8dd-848c-4f9a-a45a-5511714ffd87 1073741824 Nov 03 07:39:11 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:11 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a8781984-f080-434a-a32f-ad2a21a1f71b tempest-TestImageHashVerification-549135150 None] Copy volume to image completed successfully. Nov 03 07:39:12 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fabba8dd-848c-4f9a-a45a-5511714ffd87 1073741824" returned: 0 in 0.478s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fabba8dd-848c-4f9a-a45a-5511714ffd87 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:12 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fabba8dd-848c-4f9a-a45a-5511714ffd87 Nov 03 07:39:12 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:12 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fabba8dd-848c-4f9a-a45a-5511714ffd87" returned: 0 in 0.296s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.532s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-580543123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca19b950-bc27-4166-8815-5b3c332e269a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe8a6977ed74327801d29c36d5afdb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:03Z,use_quota=True,user_id='10e8734b49934f6ea7b6392127a03f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Creating volume ca19b950-bc27-4166-8815-5b3c332e269a {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:39:12 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ca19b950-bc27-4166-8815-5b3c332e269a 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38a4f50-aa0f-4e16-a901-0880893f536d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fabba8dd-848c-4f9a-a45a-5511714ffd87', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:12 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ca19b950-bc27-4166-8815-5b3c332e269a 1073741824 Nov 03 07:39:12 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7615de-e123-4f82-b54e-23f7ceb1f968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:12 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Volume volume-fabba8dd-848c-4f9a-a45a-5511714ffd87 (fabba8dd-848c-4f9a-a45a-5511714ffd87): created successfully Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7615de-e123-4f82-b54e-23f7ceb1f968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Flow 'volume_create_manager' (bf9f7849-f108-41f7-a8fe-34a1b340cc2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:12 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-9d071a6b-0eaa-4427-8b2f-37755b58ffa9 tempest-VolumesActionsTest-1221796826 None] Created volume successfully. Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4fa614f4-9ccd-412e-bf3f-8a69b9f5ca76 tempest-TestImageHashVerification-549135150 None] Acquiring lock "cinder-443e8b28-df1d-4aa4-98f1-3688f0009f64-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4fa614f4-9ccd-412e-bf3f-8a69b9f5ca76 tempest-TestImageHashVerification-549135150 None] Lock "cinder-443e8b28-df1d-4aa4-98f1-3688f0009f64-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4fa614f4-9ccd-412e-bf3f-8a69b9f5ca76 tempest-TestImageHashVerification-549135150 None] Acquiring lock "cinder-quobyte-443e8b28-df1d-4aa4-98f1-3688f0009f64" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4fa614f4-9ccd-412e-bf3f-8a69b9f5ca76 tempest-TestImageHashVerification-549135150 None] Lock "cinder-quobyte-443e8b28-df1d-4aa4-98f1-3688f0009f64" acquired by "delete_volume" :: waited 0.019s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac39f24a-34f4-4fb0-ad9e-1270275eff4a]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4fa614f4-9ccd-412e-bf3f-8a69b9f5ca76 tempest-TestImageHashVerification-549135150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:12 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ca19b950-bc27-4166-8815-5b3c332e269a 1073741824" returned: 0 in 0.578s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ca19b950-bc27-4166-8815-5b3c332e269a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:13 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ca19b950-bc27-4166-8815-5b3c332e269a Nov 03 07:39:13 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3d4962cc-7d1f-4caa-8c85-822159969551 tempest-VolumesActionsTest-1221796826 None] Acquiring lock "cinder-fabba8dd-848c-4f9a-a45a-5511714ffd87" by "attach_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3d4962cc-7d1f-4caa-8c85-822159969551 tempest-VolumesActionsTest-1221796826 None] Lock "cinder-fabba8dd-848c-4f9a-a45a-5511714ffd87" acquired by "attach_volume" :: waited 0.026s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:13 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64 Nov 03 07:39:13 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:13 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-3d4962cc-7d1f-4caa-8c85-822159969551 tempest-VolumesActionsTest-1221796826 None] Attaching volume fabba8dd-848c-4f9a-a45a-5511714ffd87 to instance 1d472402-9611-474c-8d19-2d19bfd61337 at mountpoint /dev/vdb on host None. Nov 03 07:39:13 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-3d4962cc-7d1f-4caa-8c85-822159969551 tempest-VolumesActionsTest-1221796826 None] Attach volume completed successfully. Nov 03 07:39:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3d4962cc-7d1f-4caa-8c85-822159969551 tempest-VolumesActionsTest-1221796826 None] Lock "cinder-fabba8dd-848c-4f9a-a45a-5511714ffd87" released by "attach_volume" :: held 0.139s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:13 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ca19b950-bc27-4166-8815-5b3c332e269a" returned: 0 in 0.363s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:39:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-c85076a2-5f33-4a53-b77e-ffd7504756b3 req-5f5faad7-21aa-4cc6-8df3-05d0fdfb5ddf tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.970s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-c85076a2-5f33-4a53-b77e-ffd7504756b3 req-5f5faad7-21aa-4cc6-8df3-05d0fdfb5ddf tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:13 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Attempting download of 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb ((None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}])) to volume ca19b950-bc27-4166-8815-5b3c332e269a. {{(pid=87016) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 03 07:39:13 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4fa614f4-9ccd-412e-bf3f-8a69b9f5ca76 tempest-TestImageHashVerification-549135150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64" returned: 0 in 0.501s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4fa614f4-9ccd-412e-bf3f-8a69b9f5ca76 tempest-TestImageHashVerification-549135150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-c85076a2-5f33-4a53-b77e-ffd7504756b3 req-5f5faad7-21aa-4cc6-8df3-05d0fdfb5ddf tempest-TestServerVolumeAttachmentScenario-715892166 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14', 'name': 'volume-882e13f8-0c47-4b53-ab9f-f6a2b38c26e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b6c858f5-8446-4e21-81a2-c481f2718f2c', 'enforce_multipath': True} {{(pid=87016) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:39:13 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64 Nov 03 07:39:13 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:13 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[e519241b-f06a-409d-b793-79b2f3b44066]: (4, 'raw') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_cr39n60e {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:13 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-c85076a2-5f33-4a53-b77e-ffd7504756b3 req-5f5faad7-21aa-4cc6-8df3-05d0fdfb5ddf tempest-TestServerVolumeAttachmentScenario-715892166 None] attachment_update completed successfully. Nov 03 07:39:13 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_cr39n60e Nov 03 07:39:13 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:13 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4fa614f4-9ccd-412e-bf3f-8a69b9f5ca76 tempest-TestImageHashVerification-549135150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-443e8b28-df1d-4aa4-98f1-3688f0009f64" returned: 0 in 0.422s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4fa614f4-9ccd-412e-bf3f-8a69b9f5ca76 tempest-TestImageHashVerification-549135150 None] Lock "cinder-quobyte-443e8b28-df1d-4aa4-98f1-3688f0009f64" released by "delete_volume" :: held 0.989s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:14 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-4fa614f4-9ccd-412e-bf3f-8a69b9f5ca76 tempest-TestImageHashVerification-549135150 None] Created reservations ['c39cf557-e657-4489-82c9-266e6ba01bd8', 'd122d66d-efb5-43c6-be81-621b90310b2c', '2a19331b-db4c-444a-be80-c5c1f681747d', 'ca244fc7-4d75-4783-978f-f0fd6cc98ed6'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:14 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_cr39n60e" returned: 0 in 0.553s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_cr39n60e {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4fa614f4-9ccd-412e-bf3f-8a69b9f5ca76 tempest-TestImageHashVerification-549135150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4fa614f4-9ccd-412e-bf3f-8a69b9f5ca76 tempest-TestImageHashVerification-549135150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4fa614f4-9ccd-412e-bf3f-8a69b9f5ca76 tempest-TestImageHashVerification-549135150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4fa614f4-9ccd-412e-bf3f-8a69b9f5ca76 tempest-TestImageHashVerification-549135150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4fa614f4-9ccd-412e-bf3f-8a69b9f5ca76 tempest-TestImageHashVerification-549135150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4fa614f4-9ccd-412e-bf3f-8a69b9f5ca76 tempest-TestImageHashVerification-549135150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:14 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:39:14 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:14 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-15d96c37-f65c-4fd4-8b41-75c92da2d615 tempest-VolumesActionsTest-1956212004 None] Terminate volume connection completed successfully. Nov 03 07:39:14 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_cr39n60e Nov 03 07:39:14 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-15d96c37-f65c-4fd4-8b41-75c92da2d615 tempest-VolumesActionsTest-1956212004 None] Acquiring lock "cinder-fabba8dd-848c-4f9a-a45a-5511714ffd87-detach_volume" by "detach_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-15d96c37-f65c-4fd4-8b41-75c92da2d615 tempest-VolumesActionsTest-1956212004 None] Lock "cinder-fabba8dd-848c-4f9a-a45a-5511714ffd87-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:14 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-15d96c37-f65c-4fd4-8b41-75c92da2d615 tempest-VolumesActionsTest-1956212004 None] Detaching volume fabba8dd-848c-4f9a-a45a-5511714ffd87 from instance 1d472402-9611-474c-8d19-2d19bfd61337. Nov 03 07:39:14 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-15d96c37-f65c-4fd4-8b41-75c92da2d615 tempest-VolumesActionsTest-1956212004 None] Detach volume completed successfully. Nov 03 07:39:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-15d96c37-f65c-4fd4-8b41-75c92da2d615 tempest-VolumesActionsTest-1956212004 None] Lock "cinder-fabba8dd-848c-4f9a-a45a-5511714ffd87-detach_volume" released by "detach_volume" :: held 0.136s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:14 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4fa614f4-9ccd-412e-bf3f-8a69b9f5ca76 tempest-TestImageHashVerification-549135150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.417s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:14 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-4fa614f4-9ccd-412e-bf3f-8a69b9f5ca76 tempest-TestImageHashVerification-549135150 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:14 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:14 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-4fa614f4-9ccd-412e-bf3f-8a69b9f5ca76 tempest-TestImageHashVerification-549135150 None] Deleted volume successfully. Nov 03 07:39:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_cr39n60e" returned: 1 in 0.577s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_cr39n60e' failed. Not Retrying. {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:39:14 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ff84ad-05da-4138-9383-4f7b2c9d1492]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7el6sea6devstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4fa614f4-9ccd-412e-bf3f-8a69b9f5ca76 tempest-TestImageHashVerification-549135150 None] Lock "cinder-443e8b28-df1d-4aa4-98f1-3688f0009f64-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-724655c7-51a2-49bf-8507-f857aeab540b tempest-VolumesActionsTest-1221796826 None] Acquiring lock "cinder-fabba8dd-848c-4f9a-a45a-5511714ffd87-detach_volume" by "detach_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-724655c7-51a2-49bf-8507-f857aeab540b tempest-VolumesActionsTest-1221796826 None] Lock "cinder-fabba8dd-848c-4f9a-a45a-5511714ffd87-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:14 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-724655c7-51a2-49bf-8507-f857aeab540b tempest-VolumesActionsTest-1221796826 None] Volume detach called, but volume not attached. Nov 03 07:39:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-724655c7-51a2-49bf-8507-f857aeab540b tempest-VolumesActionsTest-1221796826 None] Lock "cinder-fabba8dd-848c-4f9a-a45a-5511714ffd87-detach_volume" released by "detach_volume" :: held 0.034s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:14 devstack sudo[101794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7el6sea6devstack@QuobyteHD Nov 03 07:39:14 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:15 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7el6sea6devstack@QuobyteHD" returned: 0 in 0.495s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:15 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb was qcow2, converting to qcow2 {{(pid=87016) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:39:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7el6sea6devstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ca19b950-bc27-4166-8815-5b3c332e269a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-83c35125-3d88-447b-8056-5706cec86f1d tempest-VolumesActionsTest-1221796826 None] Acquiring lock "cinder-fabba8dd-848c-4f9a-a45a-5511714ffd87-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-83c35125-3d88-447b-8056-5706cec86f1d tempest-VolumesActionsTest-1221796826 None] Lock "cinder-fabba8dd-848c-4f9a-a45a-5511714ffd87-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:15 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7el6sea6devstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ca19b950-bc27-4166-8815-5b3c332e269a Nov 03 07:39:15 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-83c35125-3d88-447b-8056-5706cec86f1d tempest-VolumesActionsTest-1221796826 None] Acquiring lock "cinder-quobyte-fabba8dd-848c-4f9a-a45a-5511714ffd87" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-83c35125-3d88-447b-8056-5706cec86f1d tempest-VolumesActionsTest-1221796826 None] Lock "cinder-quobyte-fabba8dd-848c-4f9a-a45a-5511714ffd87" acquired by "delete_volume" :: waited 0.027s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:15 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a6c08b-67c6-45ac-bfb8-68ae3526c746]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-83c35125-3d88-447b-8056-5706cec86f1d tempest-VolumesActionsTest-1221796826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fabba8dd-848c-4f9a-a45a-5511714ffd87 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:15 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fabba8dd-848c-4f9a-a45a-5511714ffd87 Nov 03 07:39:15 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:15 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-83c35125-3d88-447b-8056-5706cec86f1d tempest-VolumesActionsTest-1221796826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fabba8dd-848c-4f9a-a45a-5511714ffd87" returned: 0 in 0.465s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-83c35125-3d88-447b-8056-5706cec86f1d tempest-VolumesActionsTest-1221796826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fabba8dd-848c-4f9a-a45a-5511714ffd87 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:15 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fabba8dd-848c-4f9a-a45a-5511714ffd87 Nov 03 07:39:15 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:16 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-83c35125-3d88-447b-8056-5706cec86f1d tempest-VolumesActionsTest-1221796826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fabba8dd-848c-4f9a-a45a-5511714ffd87" returned: 0 in 0.339s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:16 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-83c35125-3d88-447b-8056-5706cec86f1d tempest-VolumesActionsTest-1221796826 None] Lock "cinder-quobyte-fabba8dd-848c-4f9a-a45a-5511714ffd87" released by "delete_volume" :: held 0.905s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:16 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-83c35125-3d88-447b-8056-5706cec86f1d tempest-VolumesActionsTest-1221796826 None] Created reservations ['36021104-d599-4785-a4cc-d98b473d1c9e', '475aeda6-2a6e-429f-aad0-215c597aaf5e', 'c06dd46c-f7c3-4b9b-83cd-c48afedb73ae', '56c83977-d177-4bd8-a3f3-20222a341c97'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-83c35125-3d88-447b-8056-5706cec86f1d tempest-VolumesActionsTest-1221796826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-83c35125-3d88-447b-8056-5706cec86f1d tempest-VolumesActionsTest-1221796826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-83c35125-3d88-447b-8056-5706cec86f1d tempest-VolumesActionsTest-1221796826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-83c35125-3d88-447b-8056-5706cec86f1d tempest-VolumesActionsTest-1221796826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-83c35125-3d88-447b-8056-5706cec86f1d tempest-VolumesActionsTest-1221796826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-83c35125-3d88-447b-8056-5706cec86f1d tempest-VolumesActionsTest-1221796826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:16 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:39:16 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:16 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-83c35125-3d88-447b-8056-5706cec86f1d tempest-VolumesActionsTest-1221796826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.338s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:16 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-83c35125-3d88-447b-8056-5706cec86f1d tempest-VolumesActionsTest-1221796826 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:16 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-83c35125-3d88-447b-8056-5706cec86f1d tempest-VolumesActionsTest-1221796826 None] Deleted volume successfully. Nov 03 07:39:16 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-83c35125-3d88-447b-8056-5706cec86f1d tempest-VolumesActionsTest-1221796826 None] Lock "cinder-fabba8dd-848c-4f9a-a45a-5511714ffd87-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:17 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7el6sea6devstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ca19b950-bc27-4166-8815-5b3c332e269a" returned: 0 in 2.820s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:17 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb_7el6sea6devstack@QuobyteHD, size 112.00 MB, duration 2.82 sec, destination /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ca19b950-bc27-4166-8815-5b3c332e269a {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:39:17 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Converted 112.00 MB image at 39.70 MB/s Nov 03 07:39:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ca19b950-bc27-4166-8815-5b3c332e269a 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:17 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ca19b950-bc27-4166-8815-5b3c332e269a 1G Nov 03 07:39:17 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:18 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ca19b950-bc27-4166-8815-5b3c332e269a 1G" returned: 0 in 0.603s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:18 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Downloaded image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb ((None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}])) to volume ca19b950-bc27-4166-8815-5b3c332e269a successfully. {{(pid=87016) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 03 07:39:18 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Temporary image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb for user 10e8734b49934f6ea7b6392127a03f5c is deleted. {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:39:18 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Marking volume ca19b950-bc27-4166-8815-5b3c332e269a as bootable. {{(pid=87016) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 03 07:39:18 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Copying metadata from image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb to ca19b950-bc27-4166-8815-5b3c332e269a. {{(pid=87016) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:39:18 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Creating volume glance metadata for volume ca19b950-bc27-4166-8815-5b3c332e269a backed by image 5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87016) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:39:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70649e5c-f2d3-4695-9cc1-7155e096a448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca19b950-bc27-4166-8815-5b3c332e269a', 'volume_size': 1, 'image_id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bde64ec799a64fc39c0407ed31a11129', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb', 'created_at': datetime.datetime(2026, 11, 3, 6, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 17, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bcc0b0c-6e5a-4ab8-afcf-f2f70a76d0fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd027e3a-1fb3-423c-9c4b-767b44de410a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:18 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Volume volume-ca19b950-bc27-4166-8815-5b3c332e269a (ca19b950-bc27-4166-8815-5b3c332e269a): created successfully Nov 03 07:39:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd027e3a-1fb3-423c-9c4b-767b44de410a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Flow 'volume_create_manager' (f5e8b362-4042-4522-bd81-d6422142e773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:18 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-6cb671aa-47a2-4b80-82a2-cb4ce935c6b0 tempest-TestShelveInstance-990178793 None] Created volume successfully. Nov 03 07:39:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-fc9179d4-5f81-4ee7-8f89-53051943c953 req-1afc1d39-bfb1-42fc-aae0-2ef37fac10da tempest-TestServerVolumeAttachmentScenario-715892166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-fc9179d4-5f81-4ee7-8f89-53051943c953 req-1afc1d39-bfb1-42fc-aae0-2ef37fac10da tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-fc9179d4-5f81-4ee7-8f89-53051943c953 req-1afc1d39-bfb1-42fc-aae0-2ef37fac10da tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-fc9179d4-5f81-4ee7-8f89-53051943c953 req-1afc1d39-bfb1-42fc-aae0-2ef37fac10da tempest-TestServerVolumeAttachmentScenario-715892166 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14', 'name': 'volume-bf7f090a-c0de-44b1-9cf8-b819faaff7c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af0ab84c-6d89-4dc4-993b-f6308fee2ea5', 'enforce_multipath': True} {{(pid=87016) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:39:19 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-fc9179d4-5f81-4ee7-8f89-53051943c953 req-1afc1d39-bfb1-42fc-aae0-2ef37fac10da tempest-TestServerVolumeAttachmentScenario-715892166 None] attachment_update completed successfully. Nov 03 07:39:22 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:39:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Flow 'volume_create_manager' (381b218d-17e6-4340-baf1-e40cf715d9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b51c5936-fd40-447d-be6f-745493838e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b51c5936-fd40-447d-be6f-745493838e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1138884864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909bedd2-516d-4970-9d22-cb0c76c1224c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fe6ab2a64c41d5a7f5b4531a3f185c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:22Z,use_quota=True,user_id='853df9a3be854bbbb11887be438a6033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e2605a-b224-408b-8468-4ecb98fa6676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e2605a-b224-408b-8468-4ecb98fa6676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8780cbe3-8fa6-42c6-947d-f6901ecc71f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8780cbe3-8fa6-42c6-947d-f6901ecc71f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '909bedd2-516d-4970-9d22-cb0c76c1224c', 'volume_name': 'volume-909bedd2-516d-4970-9d22-cb0c76c1224c', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb352a64-4538-4061-85c3-4497f862af07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb352a64-4538-4061-85c3-4497f862af07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4fe33f2-babc-4983-89a0-8295d7fcda4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:22 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Volume 909bedd2-516d-4970-9d22-cb0c76c1224c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-909bedd2-516d-4970-9d22-cb0c76c1224c', 'volume_size': 1} Nov 03 07:39:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:22 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1138884864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909bedd2-516d-4970-9d22-cb0c76c1224c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fe6ab2a64c41d5a7f5b4531a3f185c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:22Z,use_quota=True,user_id='853df9a3be854bbbb11887be438a6033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:39:22 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Creating volume 909bedd2-516d-4970-9d22-cb0c76c1224c {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:39:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:22 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:22 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:22 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:39:22 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:39:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-909bedd2-516d-4970-9d22-cb0c76c1224c 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:22 devstack sudo[101876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-909bedd2-516d-4970-9d22-cb0c76c1224c 1073741824 Nov 03 07:39:22 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:22 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-500f08b7-6454-4b19-9f23-2add1b61b300 req-04bbe05f-bcbd-4513-8c06-7b733613e2dc tempest-TestServerVolumeAttachmentScenario-715892166 None] Terminate volume connection completed successfully. Nov 03 07:39:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-500f08b7-6454-4b19-9f23-2add1b61b300 req-04bbe05f-bcbd-4513-8c06-7b733613e2dc tempest-TestServerVolumeAttachmentScenario-715892166 None] Deleting attachment af0ab84c-6d89-4dc4-993b-f6308fee2ea5. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:39:23 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-909bedd2-516d-4970-9d22-cb0c76c1224c 1073741824" returned: 0 in 0.885s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-909bedd2-516d-4970-9d22-cb0c76c1224c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:23 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-909bedd2-516d-4970-9d22-cb0c76c1224c Nov 03 07:39:23 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:24 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-909bedd2-516d-4970-9d22-cb0c76c1224c" returned: 0 in 0.540s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:24 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:39:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4fe33f2-babc-4983-89a0-8295d7fcda4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-909bedd2-516d-4970-9d22-cb0c76c1224c', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ec7946-f795-4e70-a9c6-2a32a0af8c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:24 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Volume volume-909bedd2-516d-4970-9d22-cb0c76c1224c (909bedd2-516d-4970-9d22-cb0c76c1224c): created successfully Nov 03 07:39:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ec7946-f795-4e70-a9c6-2a32a0af8c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Flow 'volume_create_manager' (381b218d-17e6-4340-baf1-e40cf715d9b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:24 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-337bfeea-3750-480b-84ce-3539fbbfd214 tempest-VolumesActionsTest-1221796826 None] Created volume successfully. Nov 03 07:39:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-478ab025-6215-4196-b96f-3eb9ff627f5c req-69cba0f4-a0a4-4ccd-9e27-0d8ce97da8c0 tempest-TestShelveInstance-990178793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-478ab025-6215-4196-b96f-3eb9ff627f5c req-69cba0f4-a0a4-4ccd-9e27-0d8ce97da8c0 tempest-TestShelveInstance-990178793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-478ab025-6215-4196-b96f-3eb9ff627f5c req-69cba0f4-a0a4-4ccd-9e27-0d8ce97da8c0 tempest-TestShelveInstance-990178793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:24 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-c7ee0abf-22f6-4d75-acf5-fea033091e8e req-3c73f9cc-03c8-47a8-9526-52179120f29b tempest-TestServerVolumeAttachmentScenario-715892166 None] Terminate volume connection completed successfully. Nov 03 07:39:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-c7ee0abf-22f6-4d75-acf5-fea033091e8e req-3c73f9cc-03c8-47a8-9526-52179120f29b tempest-TestServerVolumeAttachmentScenario-715892166 None] Deleting attachment b6c858f5-8446-4e21-81a2-c481f2718f2c. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:39:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-478ab025-6215-4196-b96f-3eb9ff627f5c req-69cba0f4-a0a4-4ccd-9e27-0d8ce97da8c0 tempest-TestShelveInstance-990178793 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14', 'name': 'volume-ca19b950-bc27-4166-8815-5b3c332e269a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4cb6ef62-a7c7-46ce-9da9-ad11a559821f', 'enforce_multipath': True} {{(pid=87016) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:39:24 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-478ab025-6215-4196-b96f-3eb9ff627f5c req-69cba0f4-a0a4-4ccd-9e27-0d8ce97da8c0 tempest-TestShelveInstance-990178793 None] attachment_update completed successfully. Nov 03 07:39:25 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3239bc05-61e3-479c-b445-35efa2f51657 tempest-VolumesActionsTest-1956212004 None] Acquiring lock "cinder-909bedd2-516d-4970-9d22-cb0c76c1224c-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:25 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3239bc05-61e3-479c-b445-35efa2f51657 tempest-VolumesActionsTest-1956212004 None] Lock "cinder-909bedd2-516d-4970-9d22-cb0c76c1224c-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:25 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3239bc05-61e3-479c-b445-35efa2f51657 tempest-VolumesActionsTest-1956212004 None] Acquiring lock "cinder-quobyte-909bedd2-516d-4970-9d22-cb0c76c1224c" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:25 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3239bc05-61e3-479c-b445-35efa2f51657 tempest-VolumesActionsTest-1956212004 None] Lock "cinder-quobyte-909bedd2-516d-4970-9d22-cb0c76c1224c" acquired by "delete_volume" :: waited 0.040s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:25 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c75229-d27b-46bc-9b1f-c70aa89e7137]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3239bc05-61e3-479c-b445-35efa2f51657 tempest-VolumesActionsTest-1956212004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-909bedd2-516d-4970-9d22-cb0c76c1224c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:25 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-909bedd2-516d-4970-9d22-cb0c76c1224c Nov 03 07:39:25 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:26 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3239bc05-61e3-479c-b445-35efa2f51657 tempest-VolumesActionsTest-1956212004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-909bedd2-516d-4970-9d22-cb0c76c1224c" returned: 0 in 0.803s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3239bc05-61e3-479c-b445-35efa2f51657 tempest-VolumesActionsTest-1956212004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-909bedd2-516d-4970-9d22-cb0c76c1224c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:26 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-909bedd2-516d-4970-9d22-cb0c76c1224c Nov 03 07:39:26 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:26 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3239bc05-61e3-479c-b445-35efa2f51657 tempest-VolumesActionsTest-1956212004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-909bedd2-516d-4970-9d22-cb0c76c1224c" returned: 0 in 0.500s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:26 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3239bc05-61e3-479c-b445-35efa2f51657 tempest-VolumesActionsTest-1956212004 None] Lock "cinder-quobyte-909bedd2-516d-4970-9d22-cb0c76c1224c" released by "delete_volume" :: held 1.403s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:26 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-3239bc05-61e3-479c-b445-35efa2f51657 tempest-VolumesActionsTest-1956212004 None] Created reservations ['12881e69-3f6b-4146-9682-a30c8f718a7a', 'a00c9a68-bea7-436e-b285-34cc734db2fe', '90b005a5-2d77-41b4-bf8c-f780eae9b88a', '3276e418-c7b2-4c7f-ad25-0846fc137f22'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3239bc05-61e3-479c-b445-35efa2f51657 tempest-VolumesActionsTest-1956212004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3239bc05-61e3-479c-b445-35efa2f51657 tempest-VolumesActionsTest-1956212004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3239bc05-61e3-479c-b445-35efa2f51657 tempest-VolumesActionsTest-1956212004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3239bc05-61e3-479c-b445-35efa2f51657 tempest-VolumesActionsTest-1956212004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3239bc05-61e3-479c-b445-35efa2f51657 tempest-VolumesActionsTest-1956212004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3239bc05-61e3-479c-b445-35efa2f51657 tempest-VolumesActionsTest-1956212004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:26 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:39:26 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:27 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3239bc05-61e3-479c-b445-35efa2f51657 tempest-VolumesActionsTest-1956212004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.357s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:27 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-3239bc05-61e3-479c-b445-35efa2f51657 tempest-VolumesActionsTest-1956212004 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:27 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-3239bc05-61e3-479c-b445-35efa2f51657 tempest-VolumesActionsTest-1956212004 None] Deleted volume successfully. Nov 03 07:39:27 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3239bc05-61e3-479c-b445-35efa2f51657 tempest-VolumesActionsTest-1956212004 None] Lock "cinder-909bedd2-516d-4970-9d22-cb0c76c1224c-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:28 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:39:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Flow 'volume_create_manager' (0f52783e-a88e-4387-bbed-05dba471cb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6ce18e-6bc6-4369-b8c2-a06d6b4c049f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6ce18e-6bc6-4369-b8c2-a06d6b4c049f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1627992288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fdddeae-7b47-4fcb-b372-89635f608421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fe6ab2a64c41d5a7f5b4531a3f185c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:28Z,use_quota=True,user_id='853df9a3be854bbbb11887be438a6033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb4f273-8491-4d06-bffb-b5c54568612f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb4f273-8491-4d06-bffb-b5c54568612f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db79094-cc57-4a58-8a8d-fd84bb51ffd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db79094-cc57-4a58-8a8d-fd84bb51ffd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fdddeae-7b47-4fcb-b372-89635f608421', 'volume_name': 'volume-5fdddeae-7b47-4fcb-b372-89635f608421', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c0d559-12df-425e-a0d8-89d178268b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c0d559-12df-425e-a0d8-89d178268b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3140d9-55b7-4f5f-a50b-411386bd03b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:28 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Volume 5fdddeae-7b47-4fcb-b372-89635f608421: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fdddeae-7b47-4fcb-b372-89635f608421', 'volume_size': 1} Nov 03 07:39:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1627992288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fdddeae-7b47-4fcb-b372-89635f608421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fe6ab2a64c41d5a7f5b4531a3f185c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:28Z,use_quota=True,user_id='853df9a3be854bbbb11887be438a6033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:39:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Creating volume 5fdddeae-7b47-4fcb-b372-89635f608421 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:39:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:39:28 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:39:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5fdddeae-7b47-4fcb-b372-89635f608421 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:28 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5fdddeae-7b47-4fcb-b372-89635f608421 1073741824 Nov 03 07:39:28 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:29 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5fdddeae-7b47-4fcb-b372-89635f608421 1073741824" returned: 0 in 0.668s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5fdddeae-7b47-4fcb-b372-89635f608421 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:29 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5fdddeae-7b47-4fcb-b372-89635f608421 Nov 03 07:39:29 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:29 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5fdddeae-7b47-4fcb-b372-89635f608421" returned: 0 in 0.316s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:39:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3140d9-55b7-4f5f-a50b-411386bd03b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fdddeae-7b47-4fcb-b372-89635f608421', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8104cf5-ee30-41bb-97c1-2e813dca2b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:29 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Volume volume-5fdddeae-7b47-4fcb-b372-89635f608421 (5fdddeae-7b47-4fcb-b372-89635f608421): created successfully Nov 03 07:39:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8104cf5-ee30-41bb-97c1-2e813dca2b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Flow 'volume_create_manager' (0f52783e-a88e-4387-bbed-05dba471cb4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:29 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-3b693565-da90-4f64-8181-83164bcca6de tempest-VolumesActionsTest-1221796826 None] Created volume successfully. Nov 03 07:39:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b837335b-5b74-4d19-9f44-20e52b277359 tempest-VolumesActionsTest-1956212004 None] Acquiring lock "cinder-5fdddeae-7b47-4fcb-b372-89635f608421-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b837335b-5b74-4d19-9f44-20e52b277359 tempest-VolumesActionsTest-1956212004 None] Lock "cinder-5fdddeae-7b47-4fcb-b372-89635f608421-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b837335b-5b74-4d19-9f44-20e52b277359 tempest-VolumesActionsTest-1956212004 None] Acquiring lock "cinder-quobyte-5fdddeae-7b47-4fcb-b372-89635f608421" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b837335b-5b74-4d19-9f44-20e52b277359 tempest-VolumesActionsTest-1956212004 None] Lock "cinder-quobyte-5fdddeae-7b47-4fcb-b372-89635f608421" acquired by "delete_volume" :: waited 0.030s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:30 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e6aba4-bda7-40bc-a0b5-bbbeddf4f9f6]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b837335b-5b74-4d19-9f44-20e52b277359 tempest-VolumesActionsTest-1956212004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5fdddeae-7b47-4fcb-b372-89635f608421 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:30 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5fdddeae-7b47-4fcb-b372-89635f608421 Nov 03 07:39:30 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:31 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b837335b-5b74-4d19-9f44-20e52b277359 tempest-VolumesActionsTest-1956212004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5fdddeae-7b47-4fcb-b372-89635f608421" returned: 0 in 0.813s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b837335b-5b74-4d19-9f44-20e52b277359 tempest-VolumesActionsTest-1956212004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5fdddeae-7b47-4fcb-b372-89635f608421 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:31 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5fdddeae-7b47-4fcb-b372-89635f608421 Nov 03 07:39:31 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:32 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b837335b-5b74-4d19-9f44-20e52b277359 tempest-VolumesActionsTest-1956212004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5fdddeae-7b47-4fcb-b372-89635f608421" returned: 0 in 0.499s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b837335b-5b74-4d19-9f44-20e52b277359 tempest-VolumesActionsTest-1956212004 None] Lock "cinder-quobyte-5fdddeae-7b47-4fcb-b372-89635f608421" released by "delete_volume" :: held 1.465s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:32 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-b837335b-5b74-4d19-9f44-20e52b277359 tempest-VolumesActionsTest-1956212004 None] Created reservations ['8bf22ae6-7adc-406c-b7ae-a5382f1e65d4', '35b0aa28-2b28-4525-8359-77ac034c71ca', '2b41f005-372e-4938-91bd-6b6152190af2', '01f4b8ab-f12f-419b-9ea0-0a3cd395c040'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b837335b-5b74-4d19-9f44-20e52b277359 tempest-VolumesActionsTest-1956212004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b837335b-5b74-4d19-9f44-20e52b277359 tempest-VolumesActionsTest-1956212004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:32 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b837335b-5b74-4d19-9f44-20e52b277359 tempest-VolumesActionsTest-1956212004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:32 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b837335b-5b74-4d19-9f44-20e52b277359 tempest-VolumesActionsTest-1956212004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b837335b-5b74-4d19-9f44-20e52b277359 tempest-VolumesActionsTest-1956212004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b837335b-5b74-4d19-9f44-20e52b277359 tempest-VolumesActionsTest-1956212004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:32 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:39:32 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:32 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b837335b-5b74-4d19-9f44-20e52b277359 tempest-VolumesActionsTest-1956212004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.404s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:32 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-b837335b-5b74-4d19-9f44-20e52b277359 tempest-VolumesActionsTest-1956212004 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:32 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b837335b-5b74-4d19-9f44-20e52b277359 tempest-VolumesActionsTest-1956212004 None] Deleted volume successfully. Nov 03 07:39:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b837335b-5b74-4d19-9f44-20e52b277359 tempest-VolumesActionsTest-1956212004 None] Lock "cinder-5fdddeae-7b47-4fcb-b372-89635f608421-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:34 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:39:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Flow 'volume_create_manager' (99ebf471-cd4f-4a43-be67-0edbc33d593e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b6f75c-37c4-4aec-96fc-c88db1a8898b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b6f75c-37c4-4aec-96fc-c88db1a8898b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1992411001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317e011b-e90c-4e1a-b6b0-46b0afed9c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fe6ab2a64c41d5a7f5b4531a3f185c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:34Z,use_quota=True,user_id='853df9a3be854bbbb11887be438a6033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a30c4f68-f321-4382-a6b3-4ef87d8af5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a30c4f68-f321-4382-a6b3-4ef87d8af5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e53a90b2-8ee5-46ae-8166-b628b96d33ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e53a90b2-8ee5-46ae-8166-b628b96d33ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '317e011b-e90c-4e1a-b6b0-46b0afed9c1c', 'volume_name': 'volume-317e011b-e90c-4e1a-b6b0-46b0afed9c1c', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41992eae-1fd7-4dc7-bcfd-38a5f4c979c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41992eae-1fd7-4dc7-bcfd-38a5f4c979c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c7b189-6df7-47f3-8e91-72ccb406fdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:34 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Volume 317e011b-e90c-4e1a-b6b0-46b0afed9c1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-317e011b-e90c-4e1a-b6b0-46b0afed9c1c', 'volume_size': 1} Nov 03 07:39:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1992411001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317e011b-e90c-4e1a-b6b0-46b0afed9c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fe6ab2a64c41d5a7f5b4531a3f185c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:34Z,use_quota=True,user_id='853df9a3be854bbbb11887be438a6033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:39:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Creating volume 317e011b-e90c-4e1a-b6b0-46b0afed9c1c {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:39:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:39:34 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:39:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-317e011b-e90c-4e1a-b6b0-46b0afed9c1c 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:34 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-317e011b-e90c-4e1a-b6b0-46b0afed9c1c 1073741824 Nov 03 07:39:34 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:35 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-317e011b-e90c-4e1a-b6b0-46b0afed9c1c 1073741824" returned: 0 in 0.884s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-317e011b-e90c-4e1a-b6b0-46b0afed9c1c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:35 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-317e011b-e90c-4e1a-b6b0-46b0afed9c1c Nov 03 07:39:35 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4517f1ee-3edf-48ce-b7ca-62d33f831712 tempest-TestServerVolumeAttachmentScenario-715892166 None] Acquiring lock "cinder-bf7f090a-c0de-44b1-9cf8-b819faaff7c9-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4517f1ee-3edf-48ce-b7ca-62d33f831712 tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "cinder-bf7f090a-c0de-44b1-9cf8-b819faaff7c9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4517f1ee-3edf-48ce-b7ca-62d33f831712 tempest-TestServerVolumeAttachmentScenario-715892166 None] Acquiring lock "cinder-quobyte-bf7f090a-c0de-44b1-9cf8-b819faaff7c9" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4517f1ee-3edf-48ce-b7ca-62d33f831712 tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "cinder-quobyte-bf7f090a-c0de-44b1-9cf8-b819faaff7c9" acquired by "delete_volume" :: waited 0.037s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:35 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-317e011b-e90c-4e1a-b6b0-46b0afed9c1c" returned: 0 in 0.505s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:39:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:35 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e857e0-6bbd-4a86-af45-2d24183bb297]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4517f1ee-3edf-48ce-b7ca-62d33f831712 tempest-TestServerVolumeAttachmentScenario-715892166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bf7f090a-c0de-44b1-9cf8-b819faaff7c9 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:35 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c7b189-6df7-47f3-8e91-72ccb406fdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-317e011b-e90c-4e1a-b6b0-46b0afed9c1c', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:35 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2630c3a-252c-4ca5-ae2e-de6629de01c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:35 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Volume volume-317e011b-e90c-4e1a-b6b0-46b0afed9c1c (317e011b-e90c-4e1a-b6b0-46b0afed9c1c): created successfully Nov 03 07:39:35 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2630c3a-252c-4ca5-ae2e-de6629de01c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:35 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Flow 'volume_create_manager' (99ebf471-cd4f-4a43-be67-0edbc33d593e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:35 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-28677b14-84b5-473a-8620-015fa47e1410 tempest-VolumesActionsTest-1221796826 None] Created volume successfully. Nov 03 07:39:36 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bf7f090a-c0de-44b1-9cf8-b819faaff7c9 Nov 03 07:39:36 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a43d0d51-a3f3-4f20-b819-73fea6fef212 tempest-VolumesActionsTest-1956212004 None] Acquiring lock "cinder-317e011b-e90c-4e1a-b6b0-46b0afed9c1c-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a43d0d51-a3f3-4f20-b819-73fea6fef212 tempest-VolumesActionsTest-1956212004 None] Lock "cinder-317e011b-e90c-4e1a-b6b0-46b0afed9c1c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:36 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4517f1ee-3edf-48ce-b7ca-62d33f831712 tempest-TestServerVolumeAttachmentScenario-715892166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bf7f090a-c0de-44b1-9cf8-b819faaff7c9" returned: 0 in 0.697s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4517f1ee-3edf-48ce-b7ca-62d33f831712 tempest-TestServerVolumeAttachmentScenario-715892166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bf7f090a-c0de-44b1-9cf8-b819faaff7c9 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a43d0d51-a3f3-4f20-b819-73fea6fef212 tempest-VolumesActionsTest-1956212004 None] Acquiring lock "cinder-quobyte-317e011b-e90c-4e1a-b6b0-46b0afed9c1c" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:36 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bf7f090a-c0de-44b1-9cf8-b819faaff7c9 Nov 03 07:39:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a43d0d51-a3f3-4f20-b819-73fea6fef212 tempest-VolumesActionsTest-1956212004 None] Lock "cinder-quobyte-317e011b-e90c-4e1a-b6b0-46b0afed9c1c" acquired by "delete_volume" :: waited 0.023s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:36 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:36 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[4421124e-289f-45b1-bc3c-33e169c3e46c]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a43d0d51-a3f3-4f20-b819-73fea6fef212 tempest-VolumesActionsTest-1956212004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-317e011b-e90c-4e1a-b6b0-46b0afed9c1c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:36 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-317e011b-e90c-4e1a-b6b0-46b0afed9c1c Nov 03 07:39:36 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:37 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4517f1ee-3edf-48ce-b7ca-62d33f831712 tempest-TestServerVolumeAttachmentScenario-715892166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bf7f090a-c0de-44b1-9cf8-b819faaff7c9" returned: 0 in 0.574s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4517f1ee-3edf-48ce-b7ca-62d33f831712 tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "cinder-quobyte-bf7f090a-c0de-44b1-9cf8-b819faaff7c9" released by "delete_volume" :: held 1.389s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:37 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-4517f1ee-3edf-48ce-b7ca-62d33f831712 tempest-TestServerVolumeAttachmentScenario-715892166 None] Created reservations ['992f13de-c272-4823-b34c-0997cdc934f9', 'e00f52ca-6b18-466f-a0c1-f7d00c93c2db', 'f295eed7-8351-47da-a167-da9af2d9efe9', '17e0bfb8-9095-450c-aa48-25f20f087427'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:37 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a43d0d51-a3f3-4f20-b819-73fea6fef212 tempest-VolumesActionsTest-1956212004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-317e011b-e90c-4e1a-b6b0-46b0afed9c1c" returned: 0 in 0.771s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a43d0d51-a3f3-4f20-b819-73fea6fef212 tempest-VolumesActionsTest-1956212004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-317e011b-e90c-4e1a-b6b0-46b0afed9c1c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4517f1ee-3edf-48ce-b7ca-62d33f831712 tempest-TestServerVolumeAttachmentScenario-715892166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4517f1ee-3edf-48ce-b7ca-62d33f831712 tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:37 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-317e011b-e90c-4e1a-b6b0-46b0afed9c1c Nov 03 07:39:37 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4517f1ee-3edf-48ce-b7ca-62d33f831712 tempest-TestServerVolumeAttachmentScenario-715892166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:37 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:37 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4517f1ee-3edf-48ce-b7ca-62d33f831712 tempest-TestServerVolumeAttachmentScenario-715892166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4517f1ee-3edf-48ce-b7ca-62d33f831712 tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4517f1ee-3edf-48ce-b7ca-62d33f831712 tempest-TestServerVolumeAttachmentScenario-715892166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:37 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:39:37 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:37 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4517f1ee-3edf-48ce-b7ca-62d33f831712 tempest-TestServerVolumeAttachmentScenario-715892166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.483s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:37 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-4517f1ee-3edf-48ce-b7ca-62d33f831712 tempest-TestServerVolumeAttachmentScenario-715892166 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:37 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-4517f1ee-3edf-48ce-b7ca-62d33f831712 tempest-TestServerVolumeAttachmentScenario-715892166 None] Deleted volume successfully. Nov 03 07:39:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4517f1ee-3edf-48ce-b7ca-62d33f831712 tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "cinder-bf7f090a-c0de-44b1-9cf8-b819faaff7c9-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:37 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a43d0d51-a3f3-4f20-b819-73fea6fef212 tempest-VolumesActionsTest-1956212004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-317e011b-e90c-4e1a-b6b0-46b0afed9c1c" returned: 0 in 0.638s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a43d0d51-a3f3-4f20-b819-73fea6fef212 tempest-VolumesActionsTest-1956212004 None] Lock "cinder-quobyte-317e011b-e90c-4e1a-b6b0-46b0afed9c1c" released by "delete_volume" :: held 1.491s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:38 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-a43d0d51-a3f3-4f20-b819-73fea6fef212 tempest-VolumesActionsTest-1956212004 None] Created reservations ['7b2f8bdf-c520-4242-aa9d-8735ff8240ca', '6007dcbe-1e42-4da0-bf74-4d7a69a3643d', '3f0acdc1-15ee-4830-a7be-5b7ba75ad822', '6aab76f9-5712-406c-bcd2-10a83b94bd52'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a43d0d51-a3f3-4f20-b819-73fea6fef212 tempest-VolumesActionsTest-1956212004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a43d0d51-a3f3-4f20-b819-73fea6fef212 tempest-VolumesActionsTest-1956212004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:38 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a43d0d51-a3f3-4f20-b819-73fea6fef212 tempest-VolumesActionsTest-1956212004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:38 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a43d0d51-a3f3-4f20-b819-73fea6fef212 tempest-VolumesActionsTest-1956212004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a43d0d51-a3f3-4f20-b819-73fea6fef212 tempest-VolumesActionsTest-1956212004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a43d0d51-a3f3-4f20-b819-73fea6fef212 tempest-VolumesActionsTest-1956212004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:38 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:39:38 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2ed3c8ed-6227-41dc-9e0e-ee68f176f69a tempest-TestServerVolumeAttachmentScenario-715892166 None] Acquiring lock "cinder-882e13f8-0c47-4b53-ab9f-f6a2b38c26e4-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2ed3c8ed-6227-41dc-9e0e-ee68f176f69a tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "cinder-882e13f8-0c47-4b53-ab9f-f6a2b38c26e4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2ed3c8ed-6227-41dc-9e0e-ee68f176f69a tempest-TestServerVolumeAttachmentScenario-715892166 None] Acquiring lock "cinder-quobyte-882e13f8-0c47-4b53-ab9f-f6a2b38c26e4" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2ed3c8ed-6227-41dc-9e0e-ee68f176f69a tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "cinder-quobyte-882e13f8-0c47-4b53-ab9f-f6a2b38c26e4" acquired by "delete_volume" :: waited 0.029s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:38 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[78311576-cc70-4f1d-8661-2cbefc31b570]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2ed3c8ed-6227-41dc-9e0e-ee68f176f69a tempest-TestServerVolumeAttachmentScenario-715892166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-882e13f8-0c47-4b53-ab9f-f6a2b38c26e4 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:38 devstack sudo[102530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-882e13f8-0c47-4b53-ab9f-f6a2b38c26e4 Nov 03 07:39:38 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:39 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a43d0d51-a3f3-4f20-b819-73fea6fef212 tempest-VolumesActionsTest-1956212004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.719s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:39 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a43d0d51-a3f3-4f20-b819-73fea6fef212 tempest-VolumesActionsTest-1956212004 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:39 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a43d0d51-a3f3-4f20-b819-73fea6fef212 tempest-VolumesActionsTest-1956212004 None] Deleted volume successfully. Nov 03 07:39:39 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a43d0d51-a3f3-4f20-b819-73fea6fef212 tempest-VolumesActionsTest-1956212004 None] Lock "cinder-317e011b-e90c-4e1a-b6b0-46b0afed9c1c-delete_volume" released by "delete_volume" :: held 2.771s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:39 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2ed3c8ed-6227-41dc-9e0e-ee68f176f69a tempest-TestServerVolumeAttachmentScenario-715892166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-882e13f8-0c47-4b53-ab9f-f6a2b38c26e4" returned: 0 in 0.703s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2ed3c8ed-6227-41dc-9e0e-ee68f176f69a tempest-TestServerVolumeAttachmentScenario-715892166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-882e13f8-0c47-4b53-ab9f-f6a2b38c26e4 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:39 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-882e13f8-0c47-4b53-ab9f-f6a2b38c26e4 Nov 03 07:39:39 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:39 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:39:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Flow 'volume_create_manager' (cb8e3d45-a4ea-4c7b-bd19-50fe21810768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f900596d-d9a4-4ae8-b28b-74a8cfdae78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f900596d-d9a4-4ae8-b28b-74a8cfdae78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1097541710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7d3abe-8882-43ba-ae5e-f2f427d401d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed71047f630412f94ea259191601d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:40Z,use_quota=True,user_id='6b3f8e796f4a441cb28d22fe12aa4433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a213ae23-6e49-4e69-a07f-eac9ab5d92e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a213ae23-6e49-4e69-a07f-eac9ab5d92e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43bb6a6c-6fae-420e-8301-7aad79e13096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43bb6a6c-6fae-420e-8301-7aad79e13096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e7d3abe-8882-43ba-ae5e-f2f427d401d7', 'volume_name': 'volume-6e7d3abe-8882-43ba-ae5e-f2f427d401d7', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180acd03-6dec-44c6-b440-89acb459e0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180acd03-6dec-44c6-b440-89acb459e0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:39 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4213a4b-40e8-4b45-be22-a11fba753145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:40 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Volume 6e7d3abe-8882-43ba-ae5e-f2f427d401d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e7d3abe-8882-43ba-ae5e-f2f427d401d7', 'volume_size': 1} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1097541710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7d3abe-8882-43ba-ae5e-f2f427d401d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed71047f630412f94ea259191601d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:40Z,use_quota=True,user_id='6b3f8e796f4a441cb28d22fe12aa4433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Creating volume 6e7d3abe-8882-43ba-ae5e-f2f427d401d7 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:39:40 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6e7d3abe-8882-43ba-ae5e-f2f427d401d7 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2ed3c8ed-6227-41dc-9e0e-ee68f176f69a tempest-TestServerVolumeAttachmentScenario-715892166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-882e13f8-0c47-4b53-ab9f-f6a2b38c26e4" returned: 0 in 0.727s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:40 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6e7d3abe-8882-43ba-ae5e-f2f427d401d7 1073741824 Nov 03 07:39:40 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2ed3c8ed-6227-41dc-9e0e-ee68f176f69a tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "cinder-quobyte-882e13f8-0c47-4b53-ab9f-f6a2b38c26e4" released by "delete_volume" :: held 1.581s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Flow 'volume_create_manager' (ee309bf4-d9db-4f18-bbe4-983306db9e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1f3aca-0014-47d7-8fda-c27a4a615fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1f3aca-0014-47d7-8fda-c27a4a615fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1247689979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14dffbc-2de2-4391-b39b-a56603e15938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fe6ab2a64c41d5a7f5b4531a3f185c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:40Z,use_quota=True,user_id='853df9a3be854bbbb11887be438a6033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c968063-e8c4-412b-86b9-4ba3efc0ac0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c968063-e8c4-412b-86b9-4ba3efc0ac0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5358ae12-1129-44cd-ae2f-059befb8010b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5358ae12-1129-44cd-ae2f-059befb8010b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f14dffbc-2de2-4391-b39b-a56603e15938', 'volume_name': 'volume-f14dffbc-2de2-4391-b39b-a56603e15938', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0516a313-4686-4585-95c6-98f5b559b655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0516a313-4686-4585-95c6-98f5b559b655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d33bc7-514c-4bcc-b920-62cdb1733324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:40 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Volume f14dffbc-2de2-4391-b39b-a56603e15938: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f14dffbc-2de2-4391-b39b-a56603e15938', 'volume_size': 1} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-2ed3c8ed-6227-41dc-9e0e-ee68f176f69a tempest-TestServerVolumeAttachmentScenario-715892166 None] Created reservations ['37af3d0c-7599-446c-acfa-0525d08d5bee', 'dd692a00-dfa6-4c70-8082-423008d589ea', '5070d158-8cd3-48d4-888f-a601c5860670', '32f4e5ab-648d-43c4-b472-bea572d87ec8'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Flow 'volume_create_manager' (ca19ae54-1011-4151-a890-51125838a01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6933b9d-8dd3-4894-879f-94e62e24ed75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6933b9d-8dd3-4894-879f-94e62e24ed75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1770055097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba60e5e-8229-4757-92a1-01f5f5c71028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed71047f630412f94ea259191601d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:41Z,use_quota=True,user_id='6b3f8e796f4a441cb28d22fe12aa4433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632f0105-550c-43ff-b0f6-98dc73f3a99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632f0105-550c-43ff-b0f6-98dc73f3a99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88b5390-b2ed-4772-9efc-90e75a8d4c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88b5390-b2ed-4772-9efc-90e75a8d4c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ba60e5e-8229-4757-92a1-01f5f5c71028', 'volume_name': 'volume-4ba60e5e-8229-4757-92a1-01f5f5c71028', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8364871b-cbcd-4a31-a31f-7c42b373d859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8364871b-cbcd-4a31-a31f-7c42b373d859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12bf18a4-16dc-43a6-9467-bbe4af6ec548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:40 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Volume 4ba60e5e-8229-4757-92a1-01f5f5c71028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ba60e5e-8229-4757-92a1-01f5f5c71028', 'volume_size': 1} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2ed3c8ed-6227-41dc-9e0e-ee68f176f69a tempest-TestServerVolumeAttachmentScenario-715892166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2ed3c8ed-6227-41dc-9e0e-ee68f176f69a tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2ed3c8ed-6227-41dc-9e0e-ee68f176f69a tempest-TestServerVolumeAttachmentScenario-715892166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2ed3c8ed-6227-41dc-9e0e-ee68f176f69a tempest-TestServerVolumeAttachmentScenario-715892166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2ed3c8ed-6227-41dc-9e0e-ee68f176f69a tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2ed3c8ed-6227-41dc-9e0e-ee68f176f69a tempest-TestServerVolumeAttachmentScenario-715892166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:41 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:39:41 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:41 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6e7d3abe-8882-43ba-ae5e-f2f427d401d7 1073741824" returned: 0 in 1.071s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6e7d3abe-8882-43ba-ae5e-f2f427d401d7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:41 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6e7d3abe-8882-43ba-ae5e-f2f427d401d7 Nov 03 07:39:41 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:41 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2ed3c8ed-6227-41dc-9e0e-ee68f176f69a tempest-TestServerVolumeAttachmentScenario-715892166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.612s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:41 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-2ed3c8ed-6227-41dc-9e0e-ee68f176f69a tempest-TestServerVolumeAttachmentScenario-715892166 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:41 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-2ed3c8ed-6227-41dc-9e0e-ee68f176f69a tempest-TestServerVolumeAttachmentScenario-715892166 None] Deleted volume successfully. Nov 03 07:39:41 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2ed3c8ed-6227-41dc-9e0e-ee68f176f69a tempest-TestServerVolumeAttachmentScenario-715892166 None] Lock "cinder-882e13f8-0c47-4b53-ab9f-f6a2b38c26e4-delete_volume" released by "delete_volume" :: held 3.209s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:41 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:39:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Flow 'volume_create_manager' (d5cdb908-5ecf-4072-a946-337dcff71268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2535e244-2f0d-4b35-9be6-a92d72ea66f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2535e244-2f0d-4b35-9be6-a92d72ea66f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-542520270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95484109-f562-4c09-beb8-3cdea3634e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed71047f630412f94ea259191601d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:42Z,use_quota=True,user_id='6b3f8e796f4a441cb28d22fe12aa4433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef28246e-06b7-4f52-ad35-f302f9d186bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef28246e-06b7-4f52-ad35-f302f9d186bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d18f6172-4de5-4d8f-b25a-c9f594e5714f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d18f6172-4de5-4d8f-b25a-c9f594e5714f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95484109-f562-4c09-beb8-3cdea3634e11', 'volume_name': 'volume-95484109-f562-4c09-beb8-3cdea3634e11', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:42 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bca8077-135e-4aec-bdc4-0bce62ad340c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bca8077-135e-4aec-bdc4-0bce62ad340c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabbafcd-2d8b-463e-b2c7-1a8da36aae29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:42 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Volume 95484109-f562-4c09-beb8-3cdea3634e11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95484109-f562-4c09-beb8-3cdea3634e11', 'volume_size': 1} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6e7d3abe-8882-43ba-ae5e-f2f427d401d7" returned: 0 in 0.847s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] <== create_volume: return (2023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.037s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.491s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1247689979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14dffbc-2de2-4391-b39b-a56603e15938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fe6ab2a64c41d5a7f5b4531a3f185c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:40Z,use_quota=True,user_id='853df9a3be854bbbb11887be438a6033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Creating volume f14dffbc-2de2-4391-b39b-a56603e15938 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:39:42 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f14dffbc-2de2-4391-b39b-a56603e15938 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4213a4b-40e8-4b45-be22-a11fba753145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e7d3abe-8882-43ba-ae5e-f2f427d401d7', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:42 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f14dffbc-2de2-4391-b39b-a56603e15938 1073741824 Nov 03 07:39:42 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619db288-d455-4bad-8a47-2af636eec81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:42 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Volume volume-6e7d3abe-8882-43ba-ae5e-f2f427d401d7 (6e7d3abe-8882-43ba-ae5e-f2f427d401d7): created successfully Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619db288-d455-4bad-8a47-2af636eec81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Flow 'volume_create_manager' (cb8e3d45-a4ea-4c7b-bd19-50fe21810768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:42 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-2b7e3243-d64d-4f0e-86a3-5fa5ee1c11e5 tempest-CreateVolumesFromImageTest-1910600677 None] Created volume successfully. Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Flow 'volume_create_manager' (8d32e0a1-a628-4b38-9704-2a22db32e0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ddac6a-377a-4d26-8757-476544be84b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ddac6a-377a-4d26-8757-476544be84b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-66253656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcbea6e7-03df-4ca7-8e03-49f3d41b6990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed71047f630412f94ea259191601d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:43Z,use_quota=True,user_id='6b3f8e796f4a441cb28d22fe12aa4433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64a4e2d6-defe-4abc-96ea-bdd0865e5301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64a4e2d6-defe-4abc-96ea-bdd0865e5301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c02e0158-9f3b-469d-8b46-87349069a1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c02e0158-9f3b-469d-8b46-87349069a1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcbea6e7-03df-4ca7-8e03-49f3d41b6990', 'volume_name': 'volume-fcbea6e7-03df-4ca7-8e03-49f3d41b6990', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ea2cf1-416c-4976-a31b-8d69755179b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ea2cf1-416c-4976-a31b-8d69755179b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73ff4d6-8026-40fd-8cd3-72e30d2086c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:42 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Volume fcbea6e7-03df-4ca7-8e03-49f3d41b6990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcbea6e7-03df-4ca7-8e03-49f3d41b6990', 'volume_size': 1} Nov 03 07:39:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:43 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f14dffbc-2de2-4391-b39b-a56603e15938 1073741824" returned: 0 in 1.161s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f14dffbc-2de2-4391-b39b-a56603e15938 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:43 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f14dffbc-2de2-4391-b39b-a56603e15938 Nov 03 07:39:43 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:43 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:39:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Flow 'volume_create_manager' (ac795447-c02b-4dd7-9f6c-dc5e1d7a03c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b709019f-d7fa-44fd-962a-322072177831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b709019f-d7fa-44fd-962a-322072177831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-436739424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91759273-36dd-483e-89e0-9feeda2d6996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed71047f630412f94ea259191601d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:44Z,use_quota=True,user_id='6b3f8e796f4a441cb28d22fe12aa4433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c87f306-3e91-4dff-a0fb-e81ca4330eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c87f306-3e91-4dff-a0fb-e81ca4330eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29173181-cffa-4669-a826-550571617233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29173181-cffa-4669-a826-550571617233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91759273-36dd-483e-89e0-9feeda2d6996', 'volume_name': 'volume-91759273-36dd-483e-89e0-9feeda2d6996', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf791ee8-38b1-4002-9781-68e907ac73c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf791ee8-38b1-4002-9781-68e907ac73c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00cc8a5-c080-4deb-a7ee-6774fef8ddd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:43 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Volume 91759273-36dd-483e-89e0-9feeda2d6996: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91759273-36dd-483e-89e0-9feeda2d6996', 'volume_size': 1} Nov 03 07:39:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:43 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f14dffbc-2de2-4391-b39b-a56603e15938" returned: 0 in 0.651s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:43 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:39:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.075s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1770055097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba60e5e-8229-4757-92a1-01f5f5c71028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed71047f630412f94ea259191601d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:41Z,use_quota=True,user_id='6b3f8e796f4a441cb28d22fe12aa4433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:39:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Creating volume 4ba60e5e-8229-4757-92a1-01f5f5c71028 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:39:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:39:44 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:39:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4ba60e5e-8229-4757-92a1-01f5f5c71028 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:44 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4ba60e5e-8229-4757-92a1-01f5f5c71028 1073741824 Nov 03 07:39:44 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d33bc7-514c-4bcc-b920-62cdb1733324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f14dffbc-2de2-4391-b39b-a56603e15938', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13732971-12a4-41da-9031-077555e32f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:44 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Volume volume-f14dffbc-2de2-4391-b39b-a56603e15938 (f14dffbc-2de2-4391-b39b-a56603e15938): created successfully Nov 03 07:39:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13732971-12a4-41da-9031-077555e32f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Flow 'volume_create_manager' (ee309bf4-d9db-4f18-bbe4-983306db9e4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:44 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-94a4fa3d-96a5-4615-b8b7-c4a63ca32753 tempest-VolumesActionsTest-1221796826 None] Created volume successfully. Nov 03 07:39:44 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4ba60e5e-8229-4757-92a1-01f5f5c71028 1073741824" returned: 0 in 0.687s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4ba60e5e-8229-4757-92a1-01f5f5c71028 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:44 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4ba60e5e-8229-4757-92a1-01f5f5c71028 Nov 03 07:39:44 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:45 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4ba60e5e-8229-4757-92a1-01f5f5c71028" returned: 0 in 0.348s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.074s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-542520270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95484109-f562-4c09-beb8-3cdea3634e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed71047f630412f94ea259191601d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:42Z,use_quota=True,user_id='6b3f8e796f4a441cb28d22fe12aa4433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Creating volume 95484109-f562-4c09-beb8-3cdea3634e11 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:39:45 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-95484109-f562-4c09-beb8-3cdea3634e11 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12bf18a4-16dc-43a6-9467-bbe4af6ec548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ba60e5e-8229-4757-92a1-01f5f5c71028', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9c94c2-3ef4-4546-ba86-21ffcc7ae09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:45 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-95484109-f562-4c09-beb8-3cdea3634e11 1073741824 Nov 03 07:39:45 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:45 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Volume volume-4ba60e5e-8229-4757-92a1-01f5f5c71028 (4ba60e5e-8229-4757-92a1-01f5f5c71028): created successfully Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9c94c2-3ef4-4546-ba86-21ffcc7ae09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Flow 'volume_create_manager' (ca19ae54-1011-4151-a890-51125838a01f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:45 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-98a4cfff-b3a5-4204-a34b-4b9cfee2786c tempest-CreateVolumesFromImageTest-1910600677 None] Created volume successfully. Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9bf7dc1c-4084-46cf-9925-1561d36fe059 tempest-VolumesActionsTest-1956212004 None] Acquiring lock "cinder-f14dffbc-2de2-4391-b39b-a56603e15938-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9bf7dc1c-4084-46cf-9925-1561d36fe059 tempest-VolumesActionsTest-1956212004 None] Lock "cinder-f14dffbc-2de2-4391-b39b-a56603e15938-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9bf7dc1c-4084-46cf-9925-1561d36fe059 tempest-VolumesActionsTest-1956212004 None] Acquiring lock "cinder-quobyte-f14dffbc-2de2-4391-b39b-a56603e15938" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9bf7dc1c-4084-46cf-9925-1561d36fe059 tempest-VolumesActionsTest-1956212004 None] Lock "cinder-quobyte-f14dffbc-2de2-4391-b39b-a56603e15938" acquired by "delete_volume" :: waited 0.043s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c926acb-5f04-461d-9030-3d9f0510d873]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9bf7dc1c-4084-46cf-9925-1561d36fe059 tempest-VolumesActionsTest-1956212004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f14dffbc-2de2-4391-b39b-a56603e15938 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:45 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f14dffbc-2de2-4391-b39b-a56603e15938 Nov 03 07:39:45 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:45 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-95484109-f562-4c09-beb8-3cdea3634e11 1073741824" returned: 0 in 0.829s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-95484109-f562-4c09-beb8-3cdea3634e11 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:46 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-95484109-f562-4c09-beb8-3cdea3634e11 Nov 03 07:39:46 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:46 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9bf7dc1c-4084-46cf-9925-1561d36fe059 tempest-VolumesActionsTest-1956212004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f14dffbc-2de2-4391-b39b-a56603e15938" returned: 0 in 0.575s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9bf7dc1c-4084-46cf-9925-1561d36fe059 tempest-VolumesActionsTest-1956212004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f14dffbc-2de2-4391-b39b-a56603e15938 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:46 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f14dffbc-2de2-4391-b39b-a56603e15938 Nov 03 07:39:46 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:46 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-95484109-f562-4c09-beb8-3cdea3634e11" returned: 0 in 0.397s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:39:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.448s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-66253656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcbea6e7-03df-4ca7-8e03-49f3d41b6990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed71047f630412f94ea259191601d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:43Z,use_quota=True,user_id='6b3f8e796f4a441cb28d22fe12aa4433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:39:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Creating volume fcbea6e7-03df-4ca7-8e03-49f3d41b6990 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:39:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:39:46 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:39:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fcbea6e7-03df-4ca7-8e03-49f3d41b6990 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabbafcd-2d8b-463e-b2c7-1a8da36aae29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95484109-f562-4c09-beb8-3cdea3634e11', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc8f9a2f-eb60-4f90-8896-c9b4d1c5fd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:46 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Volume volume-95484109-f562-4c09-beb8-3cdea3634e11 (95484109-f562-4c09-beb8-3cdea3634e11): created successfully Nov 03 07:39:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc8f9a2f-eb60-4f90-8896-c9b4d1c5fd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:46 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fcbea6e7-03df-4ca7-8e03-49f3d41b6990 1073741824 Nov 03 07:39:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Flow 'volume_create_manager' (d5cdb908-5ecf-4072-a946-337dcff71268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:46 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:46 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-376bf299-9514-438c-ac14-e4e1ef167429 tempest-CreateVolumesFromImageTest-1910600677 None] Created volume successfully. Nov 03 07:39:46 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9bf7dc1c-4084-46cf-9925-1561d36fe059 tempest-VolumesActionsTest-1956212004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f14dffbc-2de2-4391-b39b-a56603e15938" returned: 0 in 0.551s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9bf7dc1c-4084-46cf-9925-1561d36fe059 tempest-VolumesActionsTest-1956212004 None] Lock "cinder-quobyte-f14dffbc-2de2-4391-b39b-a56603e15938" released by "delete_volume" :: held 1.203s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:46 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-9bf7dc1c-4084-46cf-9925-1561d36fe059 tempest-VolumesActionsTest-1956212004 None] Created reservations ['52ef68dd-b614-427d-af30-cfa6a98ac1cb', 'ee293252-55b6-40b4-858d-e99883d6305b', '2528b3a1-5e7c-42d7-bf5c-9485d803f355', 'df0cdbf2-7a34-4eea-9b92-edecf9313491'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9bf7dc1c-4084-46cf-9925-1561d36fe059 tempest-VolumesActionsTest-1956212004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9bf7dc1c-4084-46cf-9925-1561d36fe059 tempest-VolumesActionsTest-1956212004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9bf7dc1c-4084-46cf-9925-1561d36fe059 tempest-VolumesActionsTest-1956212004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9bf7dc1c-4084-46cf-9925-1561d36fe059 tempest-VolumesActionsTest-1956212004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9bf7dc1c-4084-46cf-9925-1561d36fe059 tempest-VolumesActionsTest-1956212004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9bf7dc1c-4084-46cf-9925-1561d36fe059 tempest-VolumesActionsTest-1956212004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:47 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:39:47 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:47 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fcbea6e7-03df-4ca7-8e03-49f3d41b6990 1073741824" returned: 0 in 0.785s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fcbea6e7-03df-4ca7-8e03-49f3d41b6990 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:47 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fcbea6e7-03df-4ca7-8e03-49f3d41b6990 Nov 03 07:39:47 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:47 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9bf7dc1c-4084-46cf-9925-1561d36fe059 tempest-VolumesActionsTest-1956212004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.345s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-9bf7dc1c-4084-46cf-9925-1561d36fe059 tempest-VolumesActionsTest-1956212004 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:47 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-9bf7dc1c-4084-46cf-9925-1561d36fe059 tempest-VolumesActionsTest-1956212004 None] Deleted volume successfully. Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9bf7dc1c-4084-46cf-9925-1561d36fe059 tempest-VolumesActionsTest-1956212004 None] Lock "cinder-f14dffbc-2de2-4391-b39b-a56603e15938-delete_volume" released by "delete_volume" :: held 1.946s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:47 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fcbea6e7-03df-4ca7-8e03-49f3d41b6990" returned: 0 in 0.433s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.797s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-436739424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91759273-36dd-483e-89e0-9feeda2d6996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed71047f630412f94ea259191601d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:44Z,use_quota=True,user_id='6b3f8e796f4a441cb28d22fe12aa4433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Creating volume 91759273-36dd-483e-89e0-9feeda2d6996 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:39:47 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-91759273-36dd-483e-89e0-9feeda2d6996 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73ff4d6-8026-40fd-8cd3-72e30d2086c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcbea6e7-03df-4ca7-8e03-49f3d41b6990', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3083b479-c7e0-4f91-9d46-0ec193773122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:47 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-91759273-36dd-483e-89e0-9feeda2d6996 1073741824 Nov 03 07:39:47 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:47 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Volume volume-fcbea6e7-03df-4ca7-8e03-49f3d41b6990 (fcbea6e7-03df-4ca7-8e03-49f3d41b6990): created successfully Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3083b479-c7e0-4f91-9d46-0ec193773122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Flow 'volume_create_manager' (8d32e0a1-a628-4b38-9704-2a22db32e0fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:47 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-09dbab0e-fdef-4a82-b209-6034232b6d6b tempest-CreateVolumesFromImageTest-1910600677 None] Created volume successfully. Nov 03 07:39:48 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-91759273-36dd-483e-89e0-9feeda2d6996 1073741824" returned: 0 in 0.779s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-91759273-36dd-483e-89e0-9feeda2d6996 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:48 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-91759273-36dd-483e-89e0-9feeda2d6996 Nov 03 07:39:48 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:48 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:39:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Flow 'volume_create_manager' (0ad6cd34-400d-40a1-9e1c-0291c2eed739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60408527-0d0a-4408-ab33-cee33d56146a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60408527-0d0a-4408-ab33-cee33d56146a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-294061312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98524820-45da-4eeb-8f58-377851b2fca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fe6ab2a64c41d5a7f5b4531a3f185c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:49Z,use_quota=True,user_id='853df9a3be854bbbb11887be438a6033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a53b8ce-b06c-460b-8f32-1575c9e19c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a53b8ce-b06c-460b-8f32-1575c9e19c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0fd7ec5-dfe4-4ba0-96e7-371ece265ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0fd7ec5-dfe4-4ba0-96e7-371ece265ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98524820-45da-4eeb-8f58-377851b2fca3', 'volume_name': 'volume-98524820-45da-4eeb-8f58-377851b2fca3', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421cfa5c-069e-4721-91dd-e56c84f92e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421cfa5c-069e-4721-91dd-e56c84f92e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01eaac6f-122f-4d01-8655-2f26d95f20f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:48 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Volume 98524820-45da-4eeb-8f58-377851b2fca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98524820-45da-4eeb-8f58-377851b2fca3', 'volume_size': 1} Nov 03 07:39:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:48 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-91759273-36dd-483e-89e0-9feeda2d6996" returned: 0 in 0.376s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:39:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.072s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-294061312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98524820-45da-4eeb-8f58-377851b2fca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fe6ab2a64c41d5a7f5b4531a3f185c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:49Z,use_quota=True,user_id='853df9a3be854bbbb11887be438a6033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:39:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Creating volume 98524820-45da-4eeb-8f58-377851b2fca3 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:39:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:39:49 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-98524820-45da-4eeb-8f58-377851b2fca3 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00cc8a5-c080-4deb-a7ee-6774fef8ddd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91759273-36dd-483e-89e0-9feeda2d6996', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f07ac4-0e75-4b81-a8da-a7587f469a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:49 devstack sudo[102613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-98524820-45da-4eeb-8f58-377851b2fca3 1073741824 Nov 03 07:39:49 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:49 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Volume volume-91759273-36dd-483e-89e0-9feeda2d6996 (91759273-36dd-483e-89e0-9feeda2d6996): created successfully Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f07ac4-0e75-4b81-a8da-a7587f469a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Flow 'volume_create_manager' (ac795447-c02b-4dd7-9f6c-dc5e1d7a03c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:49 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-c73aa7ce-ad33-430e-8a81-aae29a1b3fd9 tempest-CreateVolumesFromImageTest-1910600677 None] Created volume successfully. Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:49 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:39:49 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-99c09a26-e932-466f-830d-e0b5a4e62aa5 tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "cinder-91759273-36dd-483e-89e0-9feeda2d6996-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:49 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.538s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 28 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-99c09a26-e932-466f-830d-e0b5a4e62aa5 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "cinder-91759273-36dd-483e-89e0-9feeda2d6996-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:49 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-98524820-45da-4eeb-8f58-377851b2fca3 1073741824" returned: 0 in 0.753s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-99c09a26-e932-466f-830d-e0b5a4e62aa5 tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "cinder-quobyte-91759273-36dd-483e-89e0-9feeda2d6996" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-98524820-45da-4eeb-8f58-377851b2fca3 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-99c09a26-e932-466f-830d-e0b5a4e62aa5 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "cinder-quobyte-91759273-36dd-483e-89e0-9feeda2d6996" acquired by "delete_volume" :: waited 0.048s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:49 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-98524820-45da-4eeb-8f58-377851b2fca3 Nov 03 07:39:49 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[21be41bc-62e4-4055-9ad1-6132cd2ce299]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-99c09a26-e932-466f-830d-e0b5a4e62aa5 tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-91759273-36dd-483e-89e0-9feeda2d6996 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:50 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-91759273-36dd-483e-89e0-9feeda2d6996 Nov 03 07:39:50 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:50 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-98524820-45da-4eeb-8f58-377851b2fca3" returned: 0 in 0.325s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:39:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01eaac6f-122f-4d01-8655-2f26d95f20f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98524820-45da-4eeb-8f58-377851b2fca3', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9acd934-95dd-4ea1-85b1-15717a26f7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:50 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Volume volume-98524820-45da-4eeb-8f58-377851b2fca3 (98524820-45da-4eeb-8f58-377851b2fca3): created successfully Nov 03 07:39:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9acd934-95dd-4ea1-85b1-15717a26f7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Flow 'volume_create_manager' (0ad6cd34-400d-40a1-9e1c-0291c2eed739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:50 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-3d0cffcf-6d34-489f-97fc-93aed87a31b7 tempest-VolumesActionsTest-1221796826 None] Created volume successfully. Nov 03 07:39:50 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-99c09a26-e932-466f-830d-e0b5a4e62aa5 tempest-CreateVolumesFromImageTest-1910600677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-91759273-36dd-483e-89e0-9feeda2d6996" returned: 0 in 0.454s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-99c09a26-e932-466f-830d-e0b5a4e62aa5 tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-91759273-36dd-483e-89e0-9feeda2d6996 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:50 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-91759273-36dd-483e-89e0-9feeda2d6996 Nov 03 07:39:50 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:50 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-99c09a26-e932-466f-830d-e0b5a4e62aa5 tempest-CreateVolumesFromImageTest-1910600677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-91759273-36dd-483e-89e0-9feeda2d6996" returned: 0 in 0.332s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-99c09a26-e932-466f-830d-e0b5a4e62aa5 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "cinder-quobyte-91759273-36dd-483e-89e0-9feeda2d6996" released by "delete_volume" :: held 0.856s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:50 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-99c09a26-e932-466f-830d-e0b5a4e62aa5 tempest-CreateVolumesFromImageTest-1910600677 None] Created reservations ['0291166e-ba18-492e-a526-f38a38360913', '8d8cb638-ebd2-4fc7-a617-c27d9c06e142', '05dc2d4a-3dfc-43a5-93c1-bf619865dcc2', 'c407e7c6-157a-4bbf-93b6-75fab2bacdc1'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-99c09a26-e932-466f-830d-e0b5a4e62aa5 tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-99c09a26-e932-466f-830d-e0b5a4e62aa5 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-99c09a26-e932-466f-830d-e0b5a4e62aa5 tempest-CreateVolumesFromImageTest-1910600677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-99c09a26-e932-466f-830d-e0b5a4e62aa5 tempest-CreateVolumesFromImageTest-1910600677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-99c09a26-e932-466f-830d-e0b5a4e62aa5 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-99c09a26-e932-466f-830d-e0b5a4e62aa5 tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:51 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:39:51 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-88e8728e-8be9-48cd-a6e7-5cb96dc21041 tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "cinder-fcbea6e7-03df-4ca7-8e03-49f3d41b6990-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-88e8728e-8be9-48cd-a6e7-5cb96dc21041 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "cinder-fcbea6e7-03df-4ca7-8e03-49f3d41b6990-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-88e8728e-8be9-48cd-a6e7-5cb96dc21041 tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "cinder-quobyte-fcbea6e7-03df-4ca7-8e03-49f3d41b6990" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-88e8728e-8be9-48cd-a6e7-5cb96dc21041 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "cinder-quobyte-fcbea6e7-03df-4ca7-8e03-49f3d41b6990" acquired by "delete_volume" :: waited 0.033s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:51 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5fe2ad-1667-4254-9934-3b9150998d32]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-88e8728e-8be9-48cd-a6e7-5cb96dc21041 tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fcbea6e7-03df-4ca7-8e03-49f3d41b6990 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:51 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-99c09a26-e932-466f-830d-e0b5a4e62aa5 tempest-CreateVolumesFromImageTest-1910600677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.555s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:51 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-99c09a26-e932-466f-830d-e0b5a4e62aa5 tempest-CreateVolumesFromImageTest-1910600677 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:51 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fcbea6e7-03df-4ca7-8e03-49f3d41b6990 Nov 03 07:39:51 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:51 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-99c09a26-e932-466f-830d-e0b5a4e62aa5 tempest-CreateVolumesFromImageTest-1910600677 None] Deleted volume successfully. Nov 03 07:39:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-99c09a26-e932-466f-830d-e0b5a4e62aa5 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "cinder-91759273-36dd-483e-89e0-9feeda2d6996-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:51 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-88e8728e-8be9-48cd-a6e7-5cb96dc21041 tempest-CreateVolumesFromImageTest-1910600677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fcbea6e7-03df-4ca7-8e03-49f3d41b6990" returned: 0 in 0.551s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-88e8728e-8be9-48cd-a6e7-5cb96dc21041 tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fcbea6e7-03df-4ca7-8e03-49f3d41b6990 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-38815f1c-9b57-4965-9b3f-870c944afed0 tempest-VolumesActionsTest-1221796826 None] Acquiring lock "cinder-98524820-45da-4eeb-8f58-377851b2fca3-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:51 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fcbea6e7-03df-4ca7-8e03-49f3d41b6990 Nov 03 07:39:51 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-38815f1c-9b57-4965-9b3f-870c944afed0 tempest-VolumesActionsTest-1221796826 None] Lock "cinder-98524820-45da-4eeb-8f58-377851b2fca3-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-38815f1c-9b57-4965-9b3f-870c944afed0 tempest-VolumesActionsTest-1221796826 None] Acquiring lock "cinder-quobyte-98524820-45da-4eeb-8f58-377851b2fca3" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-38815f1c-9b57-4965-9b3f-870c944afed0 tempest-VolumesActionsTest-1221796826 None] Lock "cinder-quobyte-98524820-45da-4eeb-8f58-377851b2fca3" acquired by "delete_volume" :: waited 0.024s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:52 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[53708b57-840e-4cca-8fd5-f21fa6c1549c]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-38815f1c-9b57-4965-9b3f-870c944afed0 tempest-VolumesActionsTest-1221796826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-98524820-45da-4eeb-8f58-377851b2fca3 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:52 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-98524820-45da-4eeb-8f58-377851b2fca3 Nov 03 07:39:52 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:52 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-88e8728e-8be9-48cd-a6e7-5cb96dc21041 tempest-CreateVolumesFromImageTest-1910600677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fcbea6e7-03df-4ca7-8e03-49f3d41b6990" returned: 0 in 0.425s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-88e8728e-8be9-48cd-a6e7-5cb96dc21041 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "cinder-quobyte-fcbea6e7-03df-4ca7-8e03-49f3d41b6990" released by "delete_volume" :: held 1.067s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:52 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-88e8728e-8be9-48cd-a6e7-5cb96dc21041 tempest-CreateVolumesFromImageTest-1910600677 None] Created reservations ['fbce64d9-7713-4e93-a67a-4a14a25ba8a8', '9267ee08-3030-4932-aeff-cb43edffc3fe', '6e7ce1df-db27-4099-85a7-f47fe20aa1fb', '3ba8db20-a3b2-4cfa-ab9e-5bbc1a36cbd1'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-88e8728e-8be9-48cd-a6e7-5cb96dc21041 tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-88e8728e-8be9-48cd-a6e7-5cb96dc21041 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-88e8728e-8be9-48cd-a6e7-5cb96dc21041 tempest-CreateVolumesFromImageTest-1910600677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-88e8728e-8be9-48cd-a6e7-5cb96dc21041 tempest-CreateVolumesFromImageTest-1910600677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-88e8728e-8be9-48cd-a6e7-5cb96dc21041 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-88e8728e-8be9-48cd-a6e7-5cb96dc21041 tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:52 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:39:52 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:52 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-38815f1c-9b57-4965-9b3f-870c944afed0 tempest-VolumesActionsTest-1221796826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-98524820-45da-4eeb-8f58-377851b2fca3" returned: 0 in 0.579s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-38815f1c-9b57-4965-9b3f-870c944afed0 tempest-VolumesActionsTest-1221796826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-98524820-45da-4eeb-8f58-377851b2fca3 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:52 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-98524820-45da-4eeb-8f58-377851b2fca3 Nov 03 07:39:52 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:52 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-88e8728e-8be9-48cd-a6e7-5cb96dc21041 tempest-CreateVolumesFromImageTest-1910600677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.360s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:52 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-88e8728e-8be9-48cd-a6e7-5cb96dc21041 tempest-CreateVolumesFromImageTest-1910600677 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:52 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-88e8728e-8be9-48cd-a6e7-5cb96dc21041 tempest-CreateVolumesFromImageTest-1910600677 None] Deleted volume successfully. Nov 03 07:39:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-88e8728e-8be9-48cd-a6e7-5cb96dc21041 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "cinder-fcbea6e7-03df-4ca7-8e03-49f3d41b6990-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:53 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-38815f1c-9b57-4965-9b3f-870c944afed0 tempest-VolumesActionsTest-1221796826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-98524820-45da-4eeb-8f58-377851b2fca3" returned: 0 in 0.302s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-38815f1c-9b57-4965-9b3f-870c944afed0 tempest-VolumesActionsTest-1221796826 None] Lock "cinder-quobyte-98524820-45da-4eeb-8f58-377851b2fca3" released by "delete_volume" :: held 0.957s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:53 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-38815f1c-9b57-4965-9b3f-870c944afed0 tempest-VolumesActionsTest-1221796826 None] Created reservations ['80b0eb56-e5de-4f60-8ec8-fff3aeea51e2', '84863e57-1eb1-4b49-be76-2019c5d9c7dc', 'ad88e154-adb7-4139-91c2-cb22a9a88571', '2154e1cb-00a3-473c-a981-4ad41186783b'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-38815f1c-9b57-4965-9b3f-870c944afed0 tempest-VolumesActionsTest-1221796826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-38815f1c-9b57-4965-9b3f-870c944afed0 tempest-VolumesActionsTest-1221796826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-38815f1c-9b57-4965-9b3f-870c944afed0 tempest-VolumesActionsTest-1221796826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-38815f1c-9b57-4965-9b3f-870c944afed0 tempest-VolumesActionsTest-1221796826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-38815f1c-9b57-4965-9b3f-870c944afed0 tempest-VolumesActionsTest-1221796826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-38815f1c-9b57-4965-9b3f-870c944afed0 tempest-VolumesActionsTest-1221796826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:53 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:39:53 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-474e058e-44be-42ec-b6d8-f7720288868c tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "cinder-95484109-f562-4c09-beb8-3cdea3634e11-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-474e058e-44be-42ec-b6d8-f7720288868c tempest-CreateVolumesFromImageTest-1910600677 None] Lock "cinder-95484109-f562-4c09-beb8-3cdea3634e11-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-474e058e-44be-42ec-b6d8-f7720288868c tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "cinder-quobyte-95484109-f562-4c09-beb8-3cdea3634e11" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:53 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-38815f1c-9b57-4965-9b3f-870c944afed0 tempest-VolumesActionsTest-1221796826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.386s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:53 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-38815f1c-9b57-4965-9b3f-870c944afed0 tempest-VolumesActionsTest-1221796826 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:53 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-38815f1c-9b57-4965-9b3f-870c944afed0 tempest-VolumesActionsTest-1221796826 None] Deleted volume successfully. Nov 03 07:39:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-474e058e-44be-42ec-b6d8-f7720288868c tempest-CreateVolumesFromImageTest-1910600677 None] Lock "cinder-quobyte-95484109-f562-4c09-beb8-3cdea3634e11" acquired by "delete_volume" :: waited 0.030s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-38815f1c-9b57-4965-9b3f-870c944afed0 tempest-VolumesActionsTest-1221796826 None] Lock "cinder-98524820-45da-4eeb-8f58-377851b2fca3-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:53 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[11eb7e24-7a41-42a5-833d-a0ba64a447ca]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-474e058e-44be-42ec-b6d8-f7720288868c tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-95484109-f562-4c09-beb8-3cdea3634e11 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:53 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-95484109-f562-4c09-beb8-3cdea3634e11 Nov 03 07:39:53 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:54 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-474e058e-44be-42ec-b6d8-f7720288868c tempest-CreateVolumesFromImageTest-1910600677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-95484109-f562-4c09-beb8-3cdea3634e11" returned: 0 in 0.433s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-474e058e-44be-42ec-b6d8-f7720288868c tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-95484109-f562-4c09-beb8-3cdea3634e11 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:54 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-95484109-f562-4c09-beb8-3cdea3634e11 Nov 03 07:39:54 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:54 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-474e058e-44be-42ec-b6d8-f7720288868c tempest-CreateVolumesFromImageTest-1910600677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-95484109-f562-4c09-beb8-3cdea3634e11" returned: 0 in 0.334s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:54 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-474e058e-44be-42ec-b6d8-f7720288868c tempest-CreateVolumesFromImageTest-1910600677 None] Lock "cinder-quobyte-95484109-f562-4c09-beb8-3cdea3634e11" released by "delete_volume" :: held 0.844s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:54 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-474e058e-44be-42ec-b6d8-f7720288868c tempest-CreateVolumesFromImageTest-1910600677 None] Created reservations ['7bce5f0b-98c5-4546-bddb-3234beb228ba', '9e6bbd24-1af8-4d28-9f2e-7ba00fd79109', '818f2173-1eac-4963-8442-b233afaa472e', '15222f7b-5590-4f6f-a9a3-4daf71145c41'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-474e058e-44be-42ec-b6d8-f7720288868c tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-474e058e-44be-42ec-b6d8-f7720288868c tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-474e058e-44be-42ec-b6d8-f7720288868c tempest-CreateVolumesFromImageTest-1910600677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-474e058e-44be-42ec-b6d8-f7720288868c tempest-CreateVolumesFromImageTest-1910600677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-474e058e-44be-42ec-b6d8-f7720288868c tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-474e058e-44be-42ec-b6d8-f7720288868c tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:54 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:39:54 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:55 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-474e058e-44be-42ec-b6d8-f7720288868c tempest-CreateVolumesFromImageTest-1910600677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.354s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:55 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-474e058e-44be-42ec-b6d8-f7720288868c tempest-CreateVolumesFromImageTest-1910600677 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:55 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-474e058e-44be-42ec-b6d8-f7720288868c tempest-CreateVolumesFromImageTest-1910600677 None] Deleted volume successfully. Nov 03 07:39:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-474e058e-44be-42ec-b6d8-f7720288868c tempest-CreateVolumesFromImageTest-1910600677 None] Lock "cinder-95484109-f562-4c09-beb8-3cdea3634e11-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9a6cc554-5c2a-4998-be59-0b3ed82b0f6f tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "cinder-4ba60e5e-8229-4757-92a1-01f5f5c71028-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9a6cc554-5c2a-4998-be59-0b3ed82b0f6f tempest-CreateVolumesFromImageTest-1910600677 None] Lock "cinder-4ba60e5e-8229-4757-92a1-01f5f5c71028-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9a6cc554-5c2a-4998-be59-0b3ed82b0f6f tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "cinder-quobyte-4ba60e5e-8229-4757-92a1-01f5f5c71028" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9a6cc554-5c2a-4998-be59-0b3ed82b0f6f tempest-CreateVolumesFromImageTest-1910600677 None] Lock "cinder-quobyte-4ba60e5e-8229-4757-92a1-01f5f5c71028" acquired by "delete_volume" :: waited 0.016s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:55 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50c7a63-3669-4a70-9255-6aab782583ee]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9a6cc554-5c2a-4998-be59-0b3ed82b0f6f tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4ba60e5e-8229-4757-92a1-01f5f5c71028 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:56 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4ba60e5e-8229-4757-92a1-01f5f5c71028 Nov 03 07:39:56 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:56 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9a6cc554-5c2a-4998-be59-0b3ed82b0f6f tempest-CreateVolumesFromImageTest-1910600677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4ba60e5e-8229-4757-92a1-01f5f5c71028" returned: 0 in 0.474s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9a6cc554-5c2a-4998-be59-0b3ed82b0f6f tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4ba60e5e-8229-4757-92a1-01f5f5c71028 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:56 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4ba60e5e-8229-4757-92a1-01f5f5c71028 Nov 03 07:39:56 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:56 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9a6cc554-5c2a-4998-be59-0b3ed82b0f6f tempest-CreateVolumesFromImageTest-1910600677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4ba60e5e-8229-4757-92a1-01f5f5c71028" returned: 0 in 0.282s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:56 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9a6cc554-5c2a-4998-be59-0b3ed82b0f6f tempest-CreateVolumesFromImageTest-1910600677 None] Lock "cinder-quobyte-4ba60e5e-8229-4757-92a1-01f5f5c71028" released by "delete_volume" :: held 0.814s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:56 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-9a6cc554-5c2a-4998-be59-0b3ed82b0f6f tempest-CreateVolumesFromImageTest-1910600677 None] Created reservations ['fff2a5d1-c5d8-4271-ab94-19ca3a43a361', 'edb260de-d4dc-47b8-bd2a-c8b1e1647c15', '8c11b0b3-250e-4248-a5be-4103c362bdfb', 'ff75cb62-19fa-4f06-bf5f-71aafbede00a'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9a6cc554-5c2a-4998-be59-0b3ed82b0f6f tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9a6cc554-5c2a-4998-be59-0b3ed82b0f6f tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9a6cc554-5c2a-4998-be59-0b3ed82b0f6f tempest-CreateVolumesFromImageTest-1910600677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9a6cc554-5c2a-4998-be59-0b3ed82b0f6f tempest-CreateVolumesFromImageTest-1910600677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9a6cc554-5c2a-4998-be59-0b3ed82b0f6f tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9a6cc554-5c2a-4998-be59-0b3ed82b0f6f tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:56 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:39:56 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b714f487-cf9a-4626-9788-3e6a6a0e5835 tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "cinder-6e7d3abe-8882-43ba-ae5e-f2f427d401d7-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b714f487-cf9a-4626-9788-3e6a6a0e5835 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "cinder-6e7d3abe-8882-43ba-ae5e-f2f427d401d7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b714f487-cf9a-4626-9788-3e6a6a0e5835 tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "cinder-quobyte-6e7d3abe-8882-43ba-ae5e-f2f427d401d7" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b714f487-cf9a-4626-9788-3e6a6a0e5835 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "cinder-quobyte-6e7d3abe-8882-43ba-ae5e-f2f427d401d7" acquired by "delete_volume" :: waited 0.030s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:57 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[039568cc-9ef2-4e44-995f-87a915db6b9d]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b714f487-cf9a-4626-9788-3e6a6a0e5835 tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6e7d3abe-8882-43ba-ae5e-f2f427d401d7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:57 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9a6cc554-5c2a-4998-be59-0b3ed82b0f6f tempest-CreateVolumesFromImageTest-1910600677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.402s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:57 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-9a6cc554-5c2a-4998-be59-0b3ed82b0f6f tempest-CreateVolumesFromImageTest-1910600677 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:57 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-9a6cc554-5c2a-4998-be59-0b3ed82b0f6f tempest-CreateVolumesFromImageTest-1910600677 None] Deleted volume successfully. Nov 03 07:39:57 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6e7d3abe-8882-43ba-ae5e-f2f427d401d7 Nov 03 07:39:57 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9a6cc554-5c2a-4998-be59-0b3ed82b0f6f tempest-CreateVolumesFromImageTest-1910600677 None] Lock "cinder-4ba60e5e-8229-4757-92a1-01f5f5c71028-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:57 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b714f487-cf9a-4626-9788-3e6a6a0e5835 tempest-CreateVolumesFromImageTest-1910600677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6e7d3abe-8882-43ba-ae5e-f2f427d401d7" returned: 0 in 0.468s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b714f487-cf9a-4626-9788-3e6a6a0e5835 tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6e7d3abe-8882-43ba-ae5e-f2f427d401d7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:57 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6e7d3abe-8882-43ba-ae5e-f2f427d401d7 Nov 03 07:39:57 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:58 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b714f487-cf9a-4626-9788-3e6a6a0e5835 tempest-CreateVolumesFromImageTest-1910600677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6e7d3abe-8882-43ba-ae5e-f2f427d401d7" returned: 0 in 0.372s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:58 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b714f487-cf9a-4626-9788-3e6a6a0e5835 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "cinder-quobyte-6e7d3abe-8882-43ba-ae5e-f2f427d401d7" released by "delete_volume" :: held 0.906s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:58 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-b714f487-cf9a-4626-9788-3e6a6a0e5835 tempest-CreateVolumesFromImageTest-1910600677 None] Created reservations ['d103083b-67d8-4e8f-8e8c-95964701847f', '896ddd04-1336-4b28-b0d0-c1d23f899996', '952566cf-08b2-407a-a6fd-91abe1e73f7e', '1a4a2bcb-b875-4591-b19f-0ce06fcadb29'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b714f487-cf9a-4626-9788-3e6a6a0e5835 tempest-CreateVolumesFromImageTest-1910600677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b714f487-cf9a-4626-9788-3e6a6a0e5835 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b714f487-cf9a-4626-9788-3e6a6a0e5835 tempest-CreateVolumesFromImageTest-1910600677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b714f487-cf9a-4626-9788-3e6a6a0e5835 tempest-CreateVolumesFromImageTest-1910600677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b714f487-cf9a-4626-9788-3e6a6a0e5835 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b714f487-cf9a-4626-9788-3e6a6a0e5835 tempest-CreateVolumesFromImageTest-1910600677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:58 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:39:58 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:58 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b714f487-cf9a-4626-9788-3e6a6a0e5835 tempest-CreateVolumesFromImageTest-1910600677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.280s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:58 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-b714f487-cf9a-4626-9788-3e6a6a0e5835 tempest-CreateVolumesFromImageTest-1910600677 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:58 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b714f487-cf9a-4626-9788-3e6a6a0e5835 tempest-CreateVolumesFromImageTest-1910600677 None] Deleted volume successfully. Nov 03 07:39:58 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b714f487-cf9a-4626-9788-3e6a6a0e5835 tempest-CreateVolumesFromImageTest-1910600677 None] Lock "cinder-6e7d3abe-8882-43ba-ae5e-f2f427d401d7-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:00 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:00 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Flow 'volume_create_manager' (6bbf66b7-ade1-488f-80ce-05a188d0bcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:00 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf054bf-a85b-4467-b053-2ab40e816304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:00 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf054bf-a85b-4467-b053-2ab40e816304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-724755322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1a2b5e-8d3f-453d-9677-f1744434c024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec9fd319f15477591a83b9160ead0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:01Z,use_quota=True,user_id='222a5247f89f4d549b19f10695219d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:00 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdabbc57-4015-48dd-ba02-92fe0b08956f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:00 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdabbc57-4015-48dd-ba02-92fe0b08956f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:00 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8e055e-1825-4396-802b-76a5a4e57986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:00 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8e055e-1825-4396-802b-76a5a4e57986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb1a2b5e-8d3f-453d-9677-f1744434c024', 'volume_name': 'volume-bb1a2b5e-8d3f-453d-9677-f1744434c024', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:00 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f33a89f1-e3e5-4eb1-8d55-8737ee2c0c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:00 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f33a89f1-e3e5-4eb1-8d55-8737ee2c0c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:00 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607c9e3b-3f84-4cb8-aea5-254cbb542aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:00 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Volume bb1a2b5e-8d3f-453d-9677-f1744434c024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb1a2b5e-8d3f-453d-9677-f1744434c024', 'volume_size': 1} Nov 03 07:40:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-724755322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1a2b5e-8d3f-453d-9677-f1744434c024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec9fd319f15477591a83b9160ead0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:01Z,use_quota=True,user_id='222a5247f89f4d549b19f10695219d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:40:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Creating volume bb1a2b5e-8d3f-453d-9677-f1744434c024 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:40:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:40:00 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:40:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:00 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024 1073741824 Nov 03 07:40:00 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:01 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024 1073741824" returned: 0 in 0.627s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:01 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024 Nov 03 07:40:01 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:02 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024" returned: 0 in 0.471s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:02 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:40:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:02 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607c9e3b-3f84-4cb8-aea5-254cbb542aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb1a2b5e-8d3f-453d-9677-f1744434c024', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:02 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21327cd5-8295-4462-9da5-a080aaba64cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:02 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Volume volume-bb1a2b5e-8d3f-453d-9677-f1744434c024 (bb1a2b5e-8d3f-453d-9677-f1744434c024): created successfully Nov 03 07:40:02 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21327cd5-8295-4462-9da5-a080aaba64cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:02 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Flow 'volume_create_manager' (6bbf66b7-ade1-488f-80ce-05a188d0bcd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:02 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-7ebee75f-f79a-4bfb-a4d1-7e54a75b45b0 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Created volume successfully. Nov 03 07:40:03 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=129,cinder:INSERT=44,cinder:UPDATE=163,cinder:DELETE=13 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:40:03 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:UPDATE=159,cinder:SELECT=136,cinder:DELETE=14,cinder:INSERT=40 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:40:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-84cb4233-9392-4dcf-8e92-bb148c5cb09a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-84cb4233-9392-4dcf-8e92-bb148c5cb09a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:03 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-84cb4233-9392-4dcf-8e92-bb148c5cb09a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Creating offline snapshot db96f670-63d7-47a9-bc6e-ac891b02dac3 of volume bb1a2b5e-8d3f-453d-9677-f1744434c024 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:40:03 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2857e25-16c3-4845-b79d-ff7c8aae2185]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-84cb4233-9392-4dcf-8e92-bb148c5cb09a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:03 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024 Nov 03 07:40:03 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:04 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-84cb4233-9392-4dcf-8e92-bb148c5cb09a tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024" returned: 0 in 0.675s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-84cb4233-9392-4dcf-8e92-bb148c5cb09a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.db96f670-63d7-47a9-bc6e-ac891b02dac3 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:04 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.db96f670-63d7-47a9-bc6e-ac891b02dac3 1G Nov 03 07:40:04 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:04 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-84cb4233-9392-4dcf-8e92-bb148c5cb09a tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.db96f670-63d7-47a9-bc6e-ac891b02dac3 1G" returned: 0 in 0.601s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-84cb4233-9392-4dcf-8e92-bb148c5cb09a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1a2b5e-8d3f-453d-9677-f1744434c024 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.db96f670-63d7-47a9-bc6e-ac891b02dac3 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:04 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1a2b5e-8d3f-453d-9677-f1744434c024 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.db96f670-63d7-47a9-bc6e-ac891b02dac3 Nov 03 07:40:04 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:05 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-84cb4233-9392-4dcf-8e92-bb148c5cb09a tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1a2b5e-8d3f-453d-9677-f1744434c024 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.db96f670-63d7-47a9-bc6e-ac891b02dac3" returned: 0 in 0.400s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:05 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-84cb4233-9392-4dcf-8e92-bb148c5cb09a tempest-CreateVolumesFromSnapshotTest-1775671883 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.db96f670-63d7-47a9-bc6e-ac891b02dac3 is being set with open permissions: ugo+rw Nov 03 07:40:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-84cb4233-9392-4dcf-8e92-bb148c5cb09a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.db96f670-63d7-47a9-bc6e-ac891b02dac3 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:05 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.db96f670-63d7-47a9-bc6e-ac891b02dac3 Nov 03 07:40:05 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:05 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-84cb4233-9392-4dcf-8e92-bb148c5cb09a tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.db96f670-63d7-47a9-bc6e-ac891b02dac3" returned: 0 in 0.401s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-84cb4233-9392-4dcf-8e92-bb148c5cb09a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:05 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.info Nov 03 07:40:05 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:05 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-84cb4233-9392-4dcf-8e92-bb148c5cb09a tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.info" returned: 0 in 0.446s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:05 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-84cb4233-9392-4dcf-8e92-bb148c5cb09a tempest-CreateVolumesFromSnapshotTest-1775671883 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.info is being set with open permissions: ugo+rw Nov 03 07:40:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-84cb4233-9392-4dcf-8e92-bb148c5cb09a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:06 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.info Nov 03 07:40:06 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:06 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-84cb4233-9392-4dcf-8e92-bb148c5cb09a tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.info" returned: 0 in 0.441s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-84cb4233-9392-4dcf-8e92-bb148c5cb09a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.174s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:06 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-84cb4233-9392-4dcf-8e92-bb148c5cb09a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Create snapshot completed successfully Nov 03 07:40:07 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Flow 'volume_create_manager' (e546c980-c43e-414a-81a9-a8e45a3a7668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453b499c-8b72-4502-b378-5222488fb82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453b499c-8b72-4502-b378-5222488fb82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd163cea-1016-4db9-9d78-16dab73749bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f792e0e46e5143039ce857646c02c21e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:07Z,use_quota=True,user_id='33ca39996a5348da92e18e1f1246ec0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67982c02-d119-40df-a993-4c16ade706c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67982c02-d119-40df-a993-4c16ade706c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4d4ede-9705-4b82-a493-cf74804fa98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:07 devstack cinder-volume[87016]: DEBUG cinder.image.glance [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Creating Keystone auth plugin from conf {{(pid=87016) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:40:07 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-72d50b9a-28a0-442e-96a0-245ba2cc4920 req-aefadce8-adc3-4103-b217-2032f9dd89a0 tempest-TestShelveInstance-990178793 None] Terminate volume connection completed successfully. Nov 03 07:40:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-72d50b9a-28a0-442e-96a0-245ba2cc4920 req-aefadce8-adc3-4103-b217-2032f9dd89a0 tempest-TestShelveInstance-990178793 None] Deleting attachment 4cb6ef62-a7c7-46ce-9da9-ad11a559821f. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:40:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4d4ede-9705-4b82-a493-cf74804fa98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cd163cea-1016-4db9-9d78-16dab73749bb', 'volume_name': 'volume-cd163cea-1016-4db9-9d78-16dab73749bb', 'volume_size': 1, 'image_id': '1d349076-36e4-4ea1-8232-3d287cbd4819', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1d349076-36e4-4ea1-8232-3d287cbd4819', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f8a0fefb34bdc69a018cbab19762a244', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f792e0e46e5143039ce857646c02c21e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd4429065dcaa187bd6ed000d4190b22fb495270c00fac35811fccc1f4ec0d0b11fd52217959f80b8b0a4fdd28b88eca5af6d3671a876a13e1c1bd92091a84bf5', 'id': '1d349076-36e4-4ea1-8232-3d287cbd4819', 'created_at': datetime.datetime(2026, 11, 3, 6, 40, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 40, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1d349076-36e4-4ea1-8232-3d287cbd4819/file', 'properties': {}}, 'image_service': }' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ad36b3-bc15-46bb-921e-979dfe086721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ad36b3-bc15-46bb-921e-979dfe086721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a8d623d-2a41-4aed-9b90-8e799c368b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:07 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Volume cd163cea-1016-4db9-9d78-16dab73749bb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cd163cea-1016-4db9-9d78-16dab73749bb', 'volume_size': 1, 'image_id': '1d349076-36e4-4ea1-8232-3d287cbd4819', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1d349076-36e4-4ea1-8232-3d287cbd4819', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f8a0fefb34bdc69a018cbab19762a244', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f792e0e46e5143039ce857646c02c21e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd4429065dcaa187bd6ed000d4190b22fb495270c00fac35811fccc1f4ec0d0b11fd52217959f80b8b0a4fdd28b88eca5af6d3671a876a13e1c1bd92091a84bf5', 'id': '1d349076-36e4-4ea1-8232-3d287cbd4819', 'created_at': datetime.datetime(2026, 11, 3, 6, 40, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 40, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1d349076-36e4-4ea1-8232-3d287cbd4819/file', 'properties': {}}, 'image_service': } Nov 03 07:40:07 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Trying to clone cd163cea-1016-4db9-9d78-16dab73749bb from image 1d349076-36e4-4ea1-8232-3d287cbd4819 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1d349076-36e4-4ea1-8232-3d287cbd4819', 'metadata': {}}]). {{(pid=87016) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:40:08 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:40:08 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Image download 0.00 MB at 0.00 MB/s Nov 03 07:40:08 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acffa20-5a99-4e42-9b09-502a08b755a9]: (4, 'raw') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:08 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD Nov 03 07:40:08 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:08 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD" returned: 0 in 0.706s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:09 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD Nov 03 07:40:09 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Flow 'volume_create_manager' (c4c75135-76b5-437d-827e-9724299db3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4594dff-6550-4c77-8abd-8f0cec67a3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4594dff-6550-4c77-8abd-8f0cec67a3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-14311089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbbef62d-5f9c-47a3-a14a-ca44e1d489db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec9fd319f15477591a83b9160ead0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:09Z,use_quota=True,user_id='222a5247f89f4d549b19f10695219d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f4d99e-2782-4d41-bcdc-1078d644cdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f4d99e-2782-4d41-bcdc-1078d644cdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328b6c59-ffc7-4457-8051-36905984abd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328b6c59-ffc7-4457-8051-36905984abd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbbef62d-5f9c-47a3-a14a-ca44e1d489db', 'volume_name': 'volume-dbbef62d-5f9c-47a3-a14a-ca44e1d489db', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52100c19-91ed-42f4-9057-42b25bcbf6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52100c19-91ed-42f4-9057-42b25bcbf6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efbe3db7-9859-4f13-a9a1-2e666fea3f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:09 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Volume dbbef62d-5f9c-47a3-a14a-ca44e1d489db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbbef62d-5f9c-47a3-a14a-ca44e1d489db', 'volume_size': 1} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-14311089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbbef62d-5f9c-47a3-a14a-ca44e1d489db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec9fd319f15477591a83b9160ead0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:09Z,use_quota=True,user_id='222a5247f89f4d549b19f10695219d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Creating volume dbbef62d-5f9c-47a3-a14a-ca44e1d489db {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:40:09 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dbbef62d-5f9c-47a3-a14a-ca44e1d489db 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:09 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dbbef62d-5f9c-47a3-a14a-ca44e1d489db 1073741824 Nov 03 07:40:09 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:09 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD" returned: 1 in 0.561s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Temporary image 1d349076-36e4-4ea1-8232-3d287cbd4819 is fetched for user 33ca39996a5348da92e18e1f1246ec0d. {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd123c4-bb10-46c9-8dbf-c2733a49bdc2]: (4, 'raw') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Flow 'volume_create_manager' (ce68d3b1-4988-4a6f-be39-70608102dce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (303d9a14-e18b-423b-8858-ed3d88c311fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:09 devstack sudo[102831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD Nov 03 07:40:09 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (303d9a14-e18b-423b-8858-ed3d88c311fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-975544407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77626732-f299-407c-8b35-2d05abda1164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec9fd319f15477591a83b9160ead0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:10Z,use_quota=True,user_id='222a5247f89f4d549b19f10695219d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81fc12e8-5794-4ec3-90d5-08b7462c0603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81fc12e8-5794-4ec3-90d5-08b7462c0603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b9ad218-8da2-479d-abb3-21ae4febc69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b9ad218-8da2-479d-abb3-21ae4febc69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77626732-f299-407c-8b35-2d05abda1164', 'volume_name': 'volume-77626732-f299-407c-8b35-2d05abda1164', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7e43f8-99e7-4c4b-9159-74e1456df1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7e43f8-99e7-4c4b-9159-74e1456df1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0e1a63-5d3a-49b1-acd0-30640f763077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:10 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Volume 77626732-f299-407c-8b35-2d05abda1164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77626732-f299-407c-8b35-2d05abda1164', 'volume_size': 1} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:10 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dbbef62d-5f9c-47a3-a14a-ca44e1d489db 1073741824" returned: 0 in 0.890s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dbbef62d-5f9c-47a3-a14a-ca44e1d489db {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:10 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD" returned: 0 in 0.630s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:10 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dbbef62d-5f9c-47a3-a14a-ca44e1d489db Nov 03 07:40:10 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:10 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD Nov 03 07:40:10 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:10 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dbbef62d-5f9c-47a3-a14a-ca44e1d489db" returned: 0 in 0.461s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.702s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-975544407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77626732-f299-407c-8b35-2d05abda1164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec9fd319f15477591a83b9160ead0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:10Z,use_quota=True,user_id='222a5247f89f4d549b19f10695219d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Creating volume 77626732-f299-407c-8b35-2d05abda1164 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:40:10 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77626732-f299-407c-8b35-2d05abda1164 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:10 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77626732-f299-407c-8b35-2d05abda1164 1073741824 Nov 03 07:40:10 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Flow 'volume_create_manager' (6dbf3ead-857c-4c91-b81a-c478c39157e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8d056b-e85f-4ef0-bec5-1ef5f51a6550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efbe3db7-9859-4f13-a9a1-2e666fea3f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbbef62d-5f9c-47a3-a14a-ca44e1d489db', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:10 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec0d774-d461-4129-88c9-0fdb8eeb3ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD" returned: 1 in 0.667s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8d056b-e85f-4ef0-bec5-1ef5f51a6550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-362557157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4702a4b-7bea-4fbe-88ca-fd85060716a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec9fd319f15477591a83b9160ead0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:11Z,use_quota=True,user_id='222a5247f89f4d549b19f10695219d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a001c303-a9e9-429b-a166-93226a6e796d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a001c303-a9e9-429b-a166-93226a6e796d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80613ef6-5fd6-48f7-9477-77a8c9cbe15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80613ef6-5fd6-48f7-9477-77a8c9cbe15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4702a4b-7bea-4fbe-88ca-fd85060716a6', 'volume_name': 'volume-c4702a4b-7bea-4fbe-88ca-fd85060716a6', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6fbdee2-5847-4eeb-b4de-f91821d1be20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6fbdee2-5847-4eeb-b4de-f91821d1be20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b51a6a-bcdc-4a56-911f-25077e82fdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:11 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Volume c4702a4b-7bea-4fbe-88ca-fd85060716a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4702a4b-7bea-4fbe-88ca-fd85060716a6', 'volume_size': 1} Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:11 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Volume volume-dbbef62d-5f9c-47a3-a14a-ca44e1d489db (dbbef62d-5f9c-47a3-a14a-ca44e1d489db): created successfully Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec0d774-d461-4129-88c9-0fdb8eeb3ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Flow 'volume_create_manager' (c4c75135-76b5-437d-827e-9724299db3b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:11 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-4e2a1e25-7ba2-4ab1-a720-2166a63446b7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Created volume successfully. Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Flow 'volume_create_manager' (871d744a-40b6-4180-a3e3-12c8a6282743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a6207c-5a15-4d76-8308-125788f892bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a6207c-5a15-4d76-8308-125788f892bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-228651048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92976d0b-c5cc-4b84-b19d-6e22c16ac5ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec9fd319f15477591a83b9160ead0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:11Z,use_quota=True,user_id='222a5247f89f4d549b19f10695219d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59591a9b-5972-4649-882c-96a8bd4b3384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59591a9b-5972-4649-882c-96a8bd4b3384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ad8f7c-3d97-4b42-a82d-eb8bda357ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ad8f7c-3d97-4b42-a82d-eb8bda357ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92976d0b-c5cc-4b84-b19d-6e22c16ac5ba', 'volume_name': 'volume-92976d0b-c5cc-4b84-b19d-6e22c16ac5ba', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7e3c7f-5733-4c5e-be49-27989a9cd2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7e3c7f-5733-4c5e-be49-27989a9cd2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b393354-4a0e-45e1-8bd3-4dbd7ab45112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:11 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Volume 92976d0b-c5cc-4b84-b19d-6e22c16ac5ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92976d0b-c5cc-4b84-b19d-6e22c16ac5ba', 'volume_size': 1} Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:11 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77626732-f299-407c-8b35-2d05abda1164 1073741824" returned: 0 in 0.861s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77626732-f299-407c-8b35-2d05abda1164 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:11 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77626732-f299-407c-8b35-2d05abda1164 Nov 03 07:40:11 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:12 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77626732-f299-407c-8b35-2d05abda1164" returned: 0 in 0.525s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.245s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd163cea-1016-4db9-9d78-16dab73749bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f792e0e46e5143039ce857646c02c21e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:07Z,use_quota=True,user_id='33ca39996a5348da92e18e1f1246ec0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Creating volume cd163cea-1016-4db9-9d78-16dab73749bb {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:40:12 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd163cea-1016-4db9-9d78-16dab73749bb 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:12 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd163cea-1016-4db9-9d78-16dab73749bb 1073741824 Nov 03 07:40:12 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0e1a63-5d3a-49b1-acd0-30640f763077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77626732-f299-407c-8b35-2d05abda1164', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d077b8b0-f334-4392-ad4b-93a25db952c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:12 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Volume volume-77626732-f299-407c-8b35-2d05abda1164 (77626732-f299-407c-8b35-2d05abda1164): created successfully Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d077b8b0-f334-4392-ad4b-93a25db952c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Flow 'volume_create_manager' (ce68d3b1-4988-4a6f-be39-70608102dce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Flow 'volume_create_manager' (300eda10-1b13-4d21-a59b-9a138bcae03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58975caa-f36f-4b28-bd66-e2e0a34bed2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:12 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-16a27dc3-6edf-42d5-835a-1dfcf1d71de7 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Created volume successfully. Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58975caa-f36f-4b28-bd66-e2e0a34bed2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-609432056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64488e9f-bc45-44ad-9e04-553acb1c3477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec9fd319f15477591a83b9160ead0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:12Z,use_quota=True,user_id='222a5247f89f4d549b19f10695219d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01cbda6-171d-4ac5-a26b-ce310ee296b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01cbda6-171d-4ac5-a26b-ce310ee296b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1efddf9-c01c-47b6-aecc-6933c217d720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1efddf9-c01c-47b6-aecc-6933c217d720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64488e9f-bc45-44ad-9e04-553acb1c3477', 'volume_name': 'volume-64488e9f-bc45-44ad-9e04-553acb1c3477', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5edfb5-72d8-4564-9f12-d6b32d592e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5edfb5-72d8-4564-9f12-d6b32d592e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9e5979-c355-4e90-8e92-d35e835cb448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:12 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Volume 64488e9f-bc45-44ad-9e04-553acb1c3477: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64488e9f-bc45-44ad-9e04-553acb1c3477', 'volume_size': 1} Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:12 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd163cea-1016-4db9-9d78-16dab73749bb 1073741824" returned: 0 in 0.742s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd163cea-1016-4db9-9d78-16dab73749bb {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:13 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd163cea-1016-4db9-9d78-16dab73749bb Nov 03 07:40:13 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:13 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd163cea-1016-4db9-9d78-16dab73749bb" returned: 0 in 0.320s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:40:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.322s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-362557157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4702a4b-7bea-4fbe-88ca-fd85060716a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec9fd319f15477591a83b9160ead0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:11Z,use_quota=True,user_id='222a5247f89f4d549b19f10695219d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:40:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Creating volume c4702a4b-7bea-4fbe-88ca-fd85060716a6 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:40:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:40:13 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:40:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c4702a4b-7bea-4fbe-88ca-fd85060716a6 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:13 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c4702a4b-7bea-4fbe-88ca-fd85060716a6 1073741824 Nov 03 07:40:13 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:13 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Attempting download of 1d349076-36e4-4ea1-8232-3d287cbd4819 ((None, [{'url': 'file:///opt/stack/data/glance/images/1d349076-36e4-4ea1-8232-3d287cbd4819', 'metadata': {}}])) to volume cd163cea-1016-4db9-9d78-16dab73749bb. {{(pid=87016) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 03 07:40:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-ac309072-7c34-4ee1-a307-8b821f25e839 req-aaec708c-1207-40b1-b7ec-380af2f083e7 tempest-TestShelveInstance-990178793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:13 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2d878a-295f-4b0c-934b-ac11c2fec801]: (4, 'raw') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1d349076-36e4-4ea1-8232-3d287cbd4819_vuad5n6g {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:13 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1d349076-36e4-4ea1-8232-3d287cbd4819_vuad5n6g Nov 03 07:40:13 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:13 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1d349076-36e4-4ea1-8232-3d287cbd4819_vuad5n6g" returned: 0 in 0.440s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1d349076-36e4-4ea1-8232-3d287cbd4819_vuad5n6g {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:13 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c4702a4b-7bea-4fbe-88ca-fd85060716a6 1073741824" returned: 0 in 0.605s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c4702a4b-7bea-4fbe-88ca-fd85060716a6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:14 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c4702a4b-7bea-4fbe-88ca-fd85060716a6 Nov 03 07:40:14 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:14 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1d349076-36e4-4ea1-8232-3d287cbd4819_vuad5n6g Nov 03 07:40:14 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:14 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1d349076-36e4-4ea1-8232-3d287cbd4819_vuad5n6g" returned: 1 in 0.417s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1d349076-36e4-4ea1-8232-3d287cbd4819_vuad5n6g' failed. Not Retrying. {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5eac38-61e5-41a0-8dbb-523cffb9ad90]: (4, 'raw') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:14 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c4702a4b-7bea-4fbe-88ca-fd85060716a6" returned: 0 in 0.343s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.793s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-228651048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92976d0b-c5cc-4b84-b19d-6e22c16ac5ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec9fd319f15477591a83b9160ead0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:11Z,use_quota=True,user_id='222a5247f89f4d549b19f10695219d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Creating volume 92976d0b-c5cc-4b84-b19d-6e22c16ac5ba {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:40:14 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-92976d0b-c5cc-4b84-b19d-6e22c16ac5ba 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b51a6a-bcdc-4a56-911f-25077e82fdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4702a4b-7bea-4fbe-88ca-fd85060716a6', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:14 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-92976d0b-c5cc-4b84-b19d-6e22c16ac5ba 1073741824 Nov 03 07:40:14 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8504ea9c-04cf-44af-aa24-9adc0b3708b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:14 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Volume volume-c4702a4b-7bea-4fbe-88ca-fd85060716a6 (c4702a4b-7bea-4fbe-88ca-fd85060716a6): created successfully Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8504ea9c-04cf-44af-aa24-9adc0b3708b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Flow 'volume_create_manager' (6dbf3ead-857c-4c91-b81a-c478c39157e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:14 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-794cf5a3-49b6-4f12-86c5-c475472833cc tempest-CreateVolumesFromSnapshotTest-1775671883 None] Created volume successfully. Nov 03 07:40:14 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD Nov 03 07:40:14 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:14 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:14 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-92976d0b-c5cc-4b84-b19d-6e22c16ac5ba 1073741824" returned: 0 in 0.537s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:14 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD Nov 03 07:40:14 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-92976d0b-c5cc-4b84-b19d-6e22c16ac5ba {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:15 devstack sudo[102901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-92976d0b-c5cc-4b84-b19d-6e22c16ac5ba Nov 03 07:40:15 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:15 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD" returned: 1 in 0.375s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] 1d349076-36e4-4ea1-8232-3d287cbd4819 was raw, converting to qcow2 {{(pid=87016) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd163cea-1016-4db9-9d78-16dab73749bb {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:15 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd163cea-1016-4db9-9d78-16dab73749bb Nov 03 07:40:15 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:15 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-92976d0b-c5cc-4b84-b19d-6e22c16ac5ba" returned: 0 in 0.310s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.745s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-609432056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64488e9f-bc45-44ad-9e04-553acb1c3477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec9fd319f15477591a83b9160ead0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:12Z,use_quota=True,user_id='222a5247f89f4d549b19f10695219d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Creating volume 64488e9f-bc45-44ad-9e04-553acb1c3477 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:40:15 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-64488e9f-bc45-44ad-9e04-553acb1c3477 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:15 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-64488e9f-bc45-44ad-9e04-553acb1c3477 1073741824 Nov 03 07:40:15 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b393354-4a0e-45e1-8bd3-4dbd7ab45112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92976d0b-c5cc-4b84-b19d-6e22c16ac5ba', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc0efe6-222d-49eb-aa1e-46711aa20886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:15 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Volume volume-92976d0b-c5cc-4b84-b19d-6e22c16ac5ba (92976d0b-c5cc-4b84-b19d-6e22c16ac5ba): created successfully Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc0efe6-222d-49eb-aa1e-46711aa20886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Flow 'volume_create_manager' (871d744a-40b6-4180-a3e3-12c8a6282743) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:15 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-76c22a9f-8f2f-44ee-8301-5968d7bbd94b tempest-CreateVolumesFromSnapshotTest-1775671883 None] Created volume successfully. Nov 03 07:40:15 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd163cea-1016-4db9-9d78-16dab73749bb" returned: 0 in 0.662s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1d349076-36e4-4ea1-8232-3d287cbd4819_386i5t0ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd163cea-1016-4db9-9d78-16dab73749bb {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:40:15 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd163cea-1016-4db9-9d78-16dab73749bb 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:15 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd163cea-1016-4db9-9d78-16dab73749bb 1G Nov 03 07:40:15 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:15 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-64488e9f-bc45-44ad-9e04-553acb1c3477 1073741824" returned: 0 in 0.605s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-64488e9f-bc45-44ad-9e04-553acb1c3477 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:16 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-64488e9f-bc45-44ad-9e04-553acb1c3477 Nov 03 07:40:16 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:16 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-64488e9f-bc45-44ad-9e04-553acb1c3477" returned: 0 in 0.297s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:40:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-ac309072-7c34-4ee1-a307-8b821f25e839 req-aaec708c-1207-40b1-b7ec-380af2f083e7 tempest-TestShelveInstance-990178793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.821s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:16 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:16 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9e5979-c355-4e90-8e92-d35e835cb448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64488e9f-bc45-44ad-9e04-553acb1c3477', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:16 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (195551c4-ef43-468d-806a-560814a054ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd163cea-1016-4db9-9d78-16dab73749bb 1G" returned: 0 in 0.402s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:16 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Downloaded image 1d349076-36e4-4ea1-8232-3d287cbd4819 ((None, [{'url': 'file:///opt/stack/data/glance/images/1d349076-36e4-4ea1-8232-3d287cbd4819', 'metadata': {}}])) to volume cd163cea-1016-4db9-9d78-16dab73749bb successfully. {{(pid=87016) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 03 07:40:16 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Temporary image 1d349076-36e4-4ea1-8232-3d287cbd4819 for user 33ca39996a5348da92e18e1f1246ec0d is deleted. {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:40:16 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Marking volume cd163cea-1016-4db9-9d78-16dab73749bb as bootable. {{(pid=87016) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 03 07:40:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-ac309072-7c34-4ee1-a307-8b821f25e839 req-aaec708c-1207-40b1-b7ec-380af2f083e7 tempest-TestShelveInstance-990178793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:16 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Copying metadata from image 1d349076-36e4-4ea1-8232-3d287cbd4819 to cd163cea-1016-4db9-9d78-16dab73749bb. {{(pid=87016) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:40:16 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Creating volume glance metadata for volume cd163cea-1016-4db9-9d78-16dab73749bb backed by image 1d349076-36e4-4ea1-8232-3d287cbd4819 with: {'image_id': '1d349076-36e4-4ea1-8232-3d287cbd4819', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f8a0fefb34bdc69a018cbab19762a244', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87016) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:40:16 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Volume volume-64488e9f-bc45-44ad-9e04-553acb1c3477 (64488e9f-bc45-44ad-9e04-553acb1c3477): created successfully Nov 03 07:40:16 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (195551c4-ef43-468d-806a-560814a054ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:16 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Flow 'volume_create_manager' (300eda10-1b13-4d21-a59b-9a138bcae03a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:16 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a9f7cfa2-5706-4697-922a-b49fadcab659 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Created volume successfully. Nov 03 07:40:16 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-ac309072-7c34-4ee1-a307-8b821f25e839 req-aaec708c-1207-40b1-b7ec-380af2f083e7 tempest-TestShelveInstance-990178793 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14', 'name': 'volume-ca19b950-bc27-4166-8815-5b3c332e269a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e7803c4d-0817-4872-81b3-783976e13850', 'enforce_multipath': True} {{(pid=87016) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:40:16 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a8d623d-2a41-4aed-9b90-8e799c368b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd163cea-1016-4db9-9d78-16dab73749bb', 'volume_size': 1, 'image_id': '1d349076-36e4-4ea1-8232-3d287cbd4819', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1d349076-36e4-4ea1-8232-3d287cbd4819', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f8a0fefb34bdc69a018cbab19762a244', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f792e0e46e5143039ce857646c02c21e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd4429065dcaa187bd6ed000d4190b22fb495270c00fac35811fccc1f4ec0d0b11fd52217959f80b8b0a4fdd28b88eca5af6d3671a876a13e1c1bd92091a84bf5', 'id': '1d349076-36e4-4ea1-8232-3d287cbd4819', 'created_at': datetime.datetime(2026, 11, 3, 6, 40, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 40, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1d349076-36e4-4ea1-8232-3d287cbd4819/file', 'properties': {}}, 'image_service': }' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:16 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a393f4-d019-43b2-8596-70eb300a4125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:16 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Volume volume-cd163cea-1016-4db9-9d78-16dab73749bb (cd163cea-1016-4db9-9d78-16dab73749bb): created successfully Nov 03 07:40:16 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a393f4-d019-43b2-8596-70eb300a4125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:16 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Flow 'volume_create_manager' (e546c980-c43e-414a-81a9-a8e45a3a7668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:16 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-ac309072-7c34-4ee1-a307-8b821f25e839 req-aaec708c-1207-40b1-b7ec-380af2f083e7 tempest-TestShelveInstance-990178793 None] attachment_update completed successfully. Nov 03 07:40:16 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-732bb131-343d-4576-91b7-09f3e422ceb0 tempest-VolumeImageDependencyTests-358615159 None] Created volume successfully. Nov 03 07:40:17 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9ac9e94f-6d48-48b2-8d54-396e196c295e tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "cinder-64488e9f-bc45-44ad-9e04-553acb1c3477-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:17 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9ac9e94f-6d48-48b2-8d54-396e196c295e tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-64488e9f-bc45-44ad-9e04-553acb1c3477-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:17 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9ac9e94f-6d48-48b2-8d54-396e196c295e tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "cinder-quobyte-64488e9f-bc45-44ad-9e04-553acb1c3477" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:17 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9ac9e94f-6d48-48b2-8d54-396e196c295e tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-quobyte-64488e9f-bc45-44ad-9e04-553acb1c3477" acquired by "delete_volume" :: waited 0.035s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:17 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[799154c8-f254-47dd-a18a-07546282f037]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9ac9e94f-6d48-48b2-8d54-396e196c295e tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-64488e9f-bc45-44ad-9e04-553acb1c3477 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:17 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f9e17b05-17ef-4548-8464-f871960d941f tempest-VolumeImageDependencyTests-358615159 None] Acquiring lock "cinder-cd163cea-1016-4db9-9d78-16dab73749bb-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:17 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f9e17b05-17ef-4548-8464-f871960d941f tempest-VolumeImageDependencyTests-358615159 None] Lock "cinder-cd163cea-1016-4db9-9d78-16dab73749bb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:17 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f9e17b05-17ef-4548-8464-f871960d941f tempest-VolumeImageDependencyTests-358615159 None] Acquiring lock "cinder-quobyte-cd163cea-1016-4db9-9d78-16dab73749bb" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:17 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f9e17b05-17ef-4548-8464-f871960d941f tempest-VolumeImageDependencyTests-358615159 None] Lock "cinder-quobyte-cd163cea-1016-4db9-9d78-16dab73749bb" acquired by "delete_volume" :: waited 0.032s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:17 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-64488e9f-bc45-44ad-9e04-553acb1c3477 Nov 03 07:40:17 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:17 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f032ebe-d3cd-424d-ae32-3f85f8137ccb]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f9e17b05-17ef-4548-8464-f871960d941f tempest-VolumeImageDependencyTests-358615159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd163cea-1016-4db9-9d78-16dab73749bb {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:17 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd163cea-1016-4db9-9d78-16dab73749bb Nov 03 07:40:17 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:17 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9ac9e94f-6d48-48b2-8d54-396e196c295e tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-64488e9f-bc45-44ad-9e04-553acb1c3477" returned: 0 in 0.612s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9ac9e94f-6d48-48b2-8d54-396e196c295e tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-64488e9f-bc45-44ad-9e04-553acb1c3477 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:17 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-64488e9f-bc45-44ad-9e04-553acb1c3477 Nov 03 07:40:17 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:17 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Flow 'volume_create_manager' (dbd13165-4ad3-490f-a109-81854e630af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4deda152-5fcb-41ae-b97a-bd4a3df319c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4deda152-5fcb-41ae-b97a-bd4a3df319c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2074967884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7326bcd1-823b-4c57-a8f2-34880eb88a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ded5c665f9d14c96a56d04c6468c03fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:18Z,use_quota=True,user_id='247f5d7505e54478be77a02559e21a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5389d84-d05b-4b78-9ffa-9a16e29b495b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5389d84-d05b-4b78-9ffa-9a16e29b495b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095aa954-c286-4fc6-9b05-89d5bc3c617f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095aa954-c286-4fc6-9b05-89d5bc3c617f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7326bcd1-823b-4c57-a8f2-34880eb88a78', 'volume_name': 'volume-7326bcd1-823b-4c57-a8f2-34880eb88a78', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6520565a-9ae8-464f-ab05-b799efc0d1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6520565a-9ae8-464f-ab05-b799efc0d1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (293ce8a2-de84-4bbf-9814-99842ec17fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:18 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Volume 7326bcd1-823b-4c57-a8f2-34880eb88a78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7326bcd1-823b-4c57-a8f2-34880eb88a78', 'volume_size': 1} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2074967884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7326bcd1-823b-4c57-a8f2-34880eb88a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ded5c665f9d14c96a56d04c6468c03fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:18Z,use_quota=True,user_id='247f5d7505e54478be77a02559e21a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Creating volume 7326bcd1-823b-4c57-a8f2-34880eb88a78 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:40:18 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7326bcd1-823b-4c57-a8f2-34880eb88a78 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:18 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f9e17b05-17ef-4548-8464-f871960d941f tempest-VolumeImageDependencyTests-358615159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd163cea-1016-4db9-9d78-16dab73749bb" returned: 0 in 0.688s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f9e17b05-17ef-4548-8464-f871960d941f tempest-VolumeImageDependencyTests-358615159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd163cea-1016-4db9-9d78-16dab73749bb {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:18 devstack sudo[102941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7326bcd1-823b-4c57-a8f2-34880eb88a78 1073741824 Nov 03 07:40:18 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:18 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd163cea-1016-4db9-9d78-16dab73749bb Nov 03 07:40:18 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:18 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9ac9e94f-6d48-48b2-8d54-396e196c295e tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-64488e9f-bc45-44ad-9e04-553acb1c3477" returned: 0 in 0.636s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9ac9e94f-6d48-48b2-8d54-396e196c295e tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-quobyte-64488e9f-bc45-44ad-9e04-553acb1c3477" released by "delete_volume" :: held 1.349s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-9ac9e94f-6d48-48b2-8d54-396e196c295e tempest-CreateVolumesFromSnapshotTest-1775671883 None] Created reservations ['20df5ec3-160f-4d65-9b99-206ce49ce6c7', 'b47b0ac4-f539-41b2-87fe-b9fb5fba6b81', 'd4622205-ed75-4fa6-8b97-1fc083fd2746', '5c9ede0a-0154-41c1-ab73-88add0983107'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:18 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f9e17b05-17ef-4548-8464-f871960d941f tempest-VolumeImageDependencyTests-358615159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cd163cea-1016-4db9-9d78-16dab73749bb" returned: 0 in 0.502s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f9e17b05-17ef-4548-8464-f871960d941f tempest-VolumeImageDependencyTests-358615159 None] Lock "cinder-quobyte-cd163cea-1016-4db9-9d78-16dab73749bb" released by "delete_volume" :: held 1.277s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9ac9e94f-6d48-48b2-8d54-396e196c295e tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9ac9e94f-6d48-48b2-8d54-396e196c295e tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9ac9e94f-6d48-48b2-8d54-396e196c295e tempest-CreateVolumesFromSnapshotTest-1775671883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9ac9e94f-6d48-48b2-8d54-396e196c295e tempest-CreateVolumesFromSnapshotTest-1775671883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9ac9e94f-6d48-48b2-8d54-396e196c295e tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9ac9e94f-6d48-48b2-8d54-396e196c295e tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:18 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:40:18 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-f9e17b05-17ef-4548-8464-f871960d941f tempest-VolumeImageDependencyTests-358615159 None] Created reservations ['845ddc50-3382-4215-baf3-a02cf1a37180', '2ee0914c-cce7-47da-b5e8-012f6d8ed5ff', '9243cb57-bbb4-446d-a6c1-86a8a30e3d5f', 'e7f6ae97-9c85-421a-9bbf-63ab989f3167'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:18 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f9e17b05-17ef-4548-8464-f871960d941f tempest-VolumeImageDependencyTests-358615159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f9e17b05-17ef-4548-8464-f871960d941f tempest-VolumeImageDependencyTests-358615159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f9e17b05-17ef-4548-8464-f871960d941f tempest-VolumeImageDependencyTests-358615159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f9e17b05-17ef-4548-8464-f871960d941f tempest-VolumeImageDependencyTests-358615159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f9e17b05-17ef-4548-8464-f871960d941f tempest-VolumeImageDependencyTests-358615159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f9e17b05-17ef-4548-8464-f871960d941f tempest-VolumeImageDependencyTests-358615159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7326bcd1-823b-4c57-a8f2-34880eb88a78 1073741824" returned: 0 in 0.845s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:18 devstack sudo[102953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:40:18 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7326bcd1-823b-4c57-a8f2-34880eb88a78 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:19 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7326bcd1-823b-4c57-a8f2-34880eb88a78 Nov 03 07:40:19 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:19 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9ac9e94f-6d48-48b2-8d54-396e196c295e tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.383s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:19 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-9ac9e94f-6d48-48b2-8d54-396e196c295e tempest-CreateVolumesFromSnapshotTest-1775671883 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:40:19 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-9ac9e94f-6d48-48b2-8d54-396e196c295e tempest-CreateVolumesFromSnapshotTest-1775671883 None] Deleted volume successfully. Nov 03 07:40:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-9ac9e94f-6d48-48b2-8d54-396e196c295e tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-64488e9f-bc45-44ad-9e04-553acb1c3477-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:19 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f9e17b05-17ef-4548-8464-f871960d941f tempest-VolumeImageDependencyTests-358615159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.370s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:19 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-f9e17b05-17ef-4548-8464-f871960d941f tempest-VolumeImageDependencyTests-358615159 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:40:19 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-f9e17b05-17ef-4548-8464-f871960d941f tempest-VolumeImageDependencyTests-358615159 None] Deleted volume successfully. Nov 03 07:40:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f9e17b05-17ef-4548-8464-f871960d941f tempest-VolumeImageDependencyTests-358615159 None] Lock "cinder-cd163cea-1016-4db9-9d78-16dab73749bb-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:19 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7326bcd1-823b-4c57-a8f2-34880eb88a78" returned: 0 in 0.416s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:40:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (293ce8a2-de84-4bbf-9814-99842ec17fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7326bcd1-823b-4c57-a8f2-34880eb88a78', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8977067b-58e3-401b-9ffd-68833b748c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:19 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Volume volume-7326bcd1-823b-4c57-a8f2-34880eb88a78 (7326bcd1-823b-4c57-a8f2-34880eb88a78): created successfully Nov 03 07:40:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8977067b-58e3-401b-9ffd-68833b748c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Flow 'volume_create_manager' (dbd13165-4ad3-490f-a109-81854e630af2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:19 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-59ff97a8-5743-46db-82b4-f13fcdec919a tempest-VolumesTransfersV357Test-470755712 None] Created volume successfully. Nov 03 07:40:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b07b75ad-2bab-4789-b5b7-77fa3dd5068a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "cinder-92976d0b-c5cc-4b84-b19d-6e22c16ac5ba-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b07b75ad-2bab-4789-b5b7-77fa3dd5068a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-92976d0b-c5cc-4b84-b19d-6e22c16ac5ba-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b07b75ad-2bab-4789-b5b7-77fa3dd5068a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "cinder-quobyte-92976d0b-c5cc-4b84-b19d-6e22c16ac5ba" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b07b75ad-2bab-4789-b5b7-77fa3dd5068a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-quobyte-92976d0b-c5cc-4b84-b19d-6e22c16ac5ba" acquired by "delete_volume" :: waited 0.028s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:19 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[8951494d-fdeb-4f57-86cb-47b2c26789e3]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b07b75ad-2bab-4789-b5b7-77fa3dd5068a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-92976d0b-c5cc-4b84-b19d-6e22c16ac5ba {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:19 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-92976d0b-c5cc-4b84-b19d-6e22c16ac5ba Nov 03 07:40:19 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:20 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b07b75ad-2bab-4789-b5b7-77fa3dd5068a tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-92976d0b-c5cc-4b84-b19d-6e22c16ac5ba" returned: 0 in 0.686s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b07b75ad-2bab-4789-b5b7-77fa3dd5068a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-92976d0b-c5cc-4b84-b19d-6e22c16ac5ba {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:20 devstack sudo[102991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-92976d0b-c5cc-4b84-b19d-6e22c16ac5ba Nov 03 07:40:20 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:20 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b07b75ad-2bab-4789-b5b7-77fa3dd5068a tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-92976d0b-c5cc-4b84-b19d-6e22c16ac5ba" returned: 0 in 0.658s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:21 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b07b75ad-2bab-4789-b5b7-77fa3dd5068a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-quobyte-92976d0b-c5cc-4b84-b19d-6e22c16ac5ba" released by "delete_volume" :: held 1.439s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:21 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-b07b75ad-2bab-4789-b5b7-77fa3dd5068a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Created reservations ['a127dcdc-8841-4835-a26b-ce9954bfa2a0', '5e9c7781-0fdc-4fb2-bac2-d7138d0c4a8d', '643dfcfb-8977-4707-bcb0-342c3ebf33ae', 'b63fd10b-3751-4f34-9592-5b7d1bbd4e0e'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:21 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-d64079d7-6b20-4aa8-be37-6316b4864a03 tempest-VolumesTransfersV357Test-1926742589 None] Transfer volume completed successfully. Nov 03 07:40:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b07b75ad-2bab-4789-b5b7-77fa3dd5068a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b07b75ad-2bab-4789-b5b7-77fa3dd5068a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b07b75ad-2bab-4789-b5b7-77fa3dd5068a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b07b75ad-2bab-4789-b5b7-77fa3dd5068a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b07b75ad-2bab-4789-b5b7-77fa3dd5068a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b07b75ad-2bab-4789-b5b7-77fa3dd5068a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:21 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:40:21 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:21 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ce577ed5-a020-4e39-8ebb-065bae5af1f2 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "cinder-c4702a4b-7bea-4fbe-88ca-fd85060716a6-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:22 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ce577ed5-a020-4e39-8ebb-065bae5af1f2 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-c4702a4b-7bea-4fbe-88ca-fd85060716a6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:22 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ce577ed5-a020-4e39-8ebb-065bae5af1f2 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "cinder-quobyte-c4702a4b-7bea-4fbe-88ca-fd85060716a6" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:22 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ce577ed5-a020-4e39-8ebb-065bae5af1f2 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-quobyte-c4702a4b-7bea-4fbe-88ca-fd85060716a6" acquired by "delete_volume" :: waited 0.043s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:22 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b07b75ad-2bab-4789-b5b7-77fa3dd5068a tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.672s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:22 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-b07b75ad-2bab-4789-b5b7-77fa3dd5068a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:40:22 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2c9284-6e30-4faf-a039-a3273a5ab6c2]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ce577ed5-a020-4e39-8ebb-065bae5af1f2 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c4702a4b-7bea-4fbe-88ca-fd85060716a6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:22 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b07b75ad-2bab-4789-b5b7-77fa3dd5068a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Deleted volume successfully. Nov 03 07:40:22 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b07b75ad-2bab-4789-b5b7-77fa3dd5068a tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-92976d0b-c5cc-4b84-b19d-6e22c16ac5ba-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:22 devstack sudo[103455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c4702a4b-7bea-4fbe-88ca-fd85060716a6 Nov 03 07:40:22 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:22 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ce577ed5-a020-4e39-8ebb-065bae5af1f2 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c4702a4b-7bea-4fbe-88ca-fd85060716a6" returned: 0 in 0.587s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ce577ed5-a020-4e39-8ebb-065bae5af1f2 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c4702a4b-7bea-4fbe-88ca-fd85060716a6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:22 devstack sudo[103463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c4702a4b-7bea-4fbe-88ca-fd85060716a6 Nov 03 07:40:22 devstack sudo[103463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:23 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5960d3e4-41ec-42cc-b8f2-cead5546b37a tempest-VolumesTransfersV357Test-1974385651 None] Acquiring lock "cinder-7326bcd1-823b-4c57-a8f2-34880eb88a78-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:23 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5960d3e4-41ec-42cc-b8f2-cead5546b37a tempest-VolumesTransfersV357Test-1974385651 None] Lock "cinder-7326bcd1-823b-4c57-a8f2-34880eb88a78-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:23 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5960d3e4-41ec-42cc-b8f2-cead5546b37a tempest-VolumesTransfersV357Test-1974385651 None] Acquiring lock "cinder-quobyte-7326bcd1-823b-4c57-a8f2-34880eb88a78" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:23 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5960d3e4-41ec-42cc-b8f2-cead5546b37a tempest-VolumesTransfersV357Test-1974385651 None] Lock "cinder-quobyte-7326bcd1-823b-4c57-a8f2-34880eb88a78" acquired by "delete_volume" :: waited 0.031s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:23 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab808a3f-4fd5-48ef-811c-e10cde846a27]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5960d3e4-41ec-42cc-b8f2-cead5546b37a tempest-VolumesTransfersV357Test-1974385651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7326bcd1-823b-4c57-a8f2-34880eb88a78 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:23 devstack sudo[103463]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ce577ed5-a020-4e39-8ebb-065bae5af1f2 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c4702a4b-7bea-4fbe-88ca-fd85060716a6" returned: 0 in 0.491s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:23 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ce577ed5-a020-4e39-8ebb-065bae5af1f2 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-quobyte-c4702a4b-7bea-4fbe-88ca-fd85060716a6" released by "delete_volume" :: held 1.223s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:23 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7326bcd1-823b-4c57-a8f2-34880eb88a78 Nov 03 07:40:23 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:23 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-ce577ed5-a020-4e39-8ebb-065bae5af1f2 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Created reservations ['8494ae81-dab3-402a-a026-0a8f9fc5f2c7', '0aaebef2-a9a7-42db-a311-40c86a042a72', 'd1ec86c9-6eaa-4ad2-b0f1-435091d198bd', '91d3567a-fafb-4fe6-8ce2-b55ce9f1dcc8'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ce577ed5-a020-4e39-8ebb-065bae5af1f2 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ce577ed5-a020-4e39-8ebb-065bae5af1f2 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ce577ed5-a020-4e39-8ebb-065bae5af1f2 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ce577ed5-a020-4e39-8ebb-065bae5af1f2 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ce577ed5-a020-4e39-8ebb-065bae5af1f2 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ce577ed5-a020-4e39-8ebb-065bae5af1f2 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:23 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:40:23 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:24 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5960d3e4-41ec-42cc-b8f2-cead5546b37a tempest-VolumesTransfersV357Test-1974385651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7326bcd1-823b-4c57-a8f2-34880eb88a78" returned: 0 in 0.924s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5960d3e4-41ec-42cc-b8f2-cead5546b37a tempest-VolumesTransfersV357Test-1974385651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7326bcd1-823b-4c57-a8f2-34880eb88a78 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:24 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7326bcd1-823b-4c57-a8f2-34880eb88a78 Nov 03 07:40:24 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:24 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ce577ed5-a020-4e39-8ebb-065bae5af1f2 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.367s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:24 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-ce577ed5-a020-4e39-8ebb-065bae5af1f2 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:40:24 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ce577ed5-a020-4e39-8ebb-065bae5af1f2 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Deleted volume successfully. Nov 03 07:40:24 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ce577ed5-a020-4e39-8ebb-065bae5af1f2 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-c4702a4b-7bea-4fbe-88ca-fd85060716a6-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:24 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-52c4845b-3772-44ec-ae65-9df8bdeac795 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "cinder-77626732-f299-407c-8b35-2d05abda1164-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:24 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-52c4845b-3772-44ec-ae65-9df8bdeac795 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-77626732-f299-407c-8b35-2d05abda1164-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:24 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5960d3e4-41ec-42cc-b8f2-cead5546b37a tempest-VolumesTransfersV357Test-1974385651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7326bcd1-823b-4c57-a8f2-34880eb88a78" returned: 0 in 0.463s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:24 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5960d3e4-41ec-42cc-b8f2-cead5546b37a tempest-VolumesTransfersV357Test-1974385651 None] Lock "cinder-quobyte-7326bcd1-823b-4c57-a8f2-34880eb88a78" released by "delete_volume" :: held 1.489s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:24 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-52c4845b-3772-44ec-ae65-9df8bdeac795 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "cinder-quobyte-77626732-f299-407c-8b35-2d05abda1164" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:24 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-52c4845b-3772-44ec-ae65-9df8bdeac795 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-quobyte-77626732-f299-407c-8b35-2d05abda1164" acquired by "delete_volume" :: waited 0.054s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:24 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[938053f3-82f9-4875-9de6-f20057fee3e6]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-52c4845b-3772-44ec-ae65-9df8bdeac795 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77626732-f299-407c-8b35-2d05abda1164 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:24 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-5960d3e4-41ec-42cc-b8f2-cead5546b37a tempest-VolumesTransfersV357Test-1974385651 None] Created reservations ['cdc3747d-4377-4b1b-ae11-56ba37a007cb', '55df6e8a-86c9-4860-a5ce-a3e26bc90951', 'bcc121be-c7f5-408c-9dad-d8631a782a73', 'a015a6d9-c0e4-459d-a622-9801b7e419fc'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:24 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77626732-f299-407c-8b35-2d05abda1164 Nov 03 07:40:24 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5960d3e4-41ec-42cc-b8f2-cead5546b37a tempest-VolumesTransfersV357Test-1974385651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5960d3e4-41ec-42cc-b8f2-cead5546b37a tempest-VolumesTransfersV357Test-1974385651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5960d3e4-41ec-42cc-b8f2-cead5546b37a tempest-VolumesTransfersV357Test-1974385651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5960d3e4-41ec-42cc-b8f2-cead5546b37a tempest-VolumesTransfersV357Test-1974385651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5960d3e4-41ec-42cc-b8f2-cead5546b37a tempest-VolumesTransfersV357Test-1974385651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5960d3e4-41ec-42cc-b8f2-cead5546b37a tempest-VolumesTransfersV357Test-1974385651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:25 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:40:25 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:25 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-52c4845b-3772-44ec-ae65-9df8bdeac795 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77626732-f299-407c-8b35-2d05abda1164" returned: 0 in 0.641s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-52c4845b-3772-44ec-ae65-9df8bdeac795 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77626732-f299-407c-8b35-2d05abda1164 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:25 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77626732-f299-407c-8b35-2d05abda1164 Nov 03 07:40:25 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:25 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5960d3e4-41ec-42cc-b8f2-cead5546b37a tempest-VolumesTransfersV357Test-1974385651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.565s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:25 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-5960d3e4-41ec-42cc-b8f2-cead5546b37a tempest-VolumesTransfersV357Test-1974385651 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:40:25 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-5960d3e4-41ec-42cc-b8f2-cead5546b37a tempest-VolumesTransfersV357Test-1974385651 None] Deleted volume successfully. Nov 03 07:40:25 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5960d3e4-41ec-42cc-b8f2-cead5546b37a tempest-VolumesTransfersV357Test-1974385651 None] Lock "cinder-7326bcd1-823b-4c57-a8f2-34880eb88a78-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:25 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-52c4845b-3772-44ec-ae65-9df8bdeac795 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-77626732-f299-407c-8b35-2d05abda1164" returned: 0 in 0.491s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:25 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-52c4845b-3772-44ec-ae65-9df8bdeac795 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-quobyte-77626732-f299-407c-8b35-2d05abda1164" released by "delete_volume" :: held 1.221s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-52c4845b-3772-44ec-ae65-9df8bdeac795 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Created reservations ['33431f20-5345-4a29-acd3-bb99feceeb4a', '3b22e703-d64d-4fa3-92c5-1c96717a9d90', 'f51b3240-0286-4a39-96dd-68619df3a174', '8aa8b538-3d44-4bb6-9eac-db4aac785db9'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-52c4845b-3772-44ec-ae65-9df8bdeac795 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-52c4845b-3772-44ec-ae65-9df8bdeac795 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-52c4845b-3772-44ec-ae65-9df8bdeac795 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-52c4845b-3772-44ec-ae65-9df8bdeac795 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-52c4845b-3772-44ec-ae65-9df8bdeac795 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-52c4845b-3772-44ec-ae65-9df8bdeac795 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:26 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:40:26 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Flow 'volume_create_manager' (4fb5cfb8-f085-41e6-9da2-fb0d0d7b55b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c4bbda-e95d-421b-bacd-561e4efc9a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c4bbda-e95d-421b-bacd-561e4efc9a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-239112929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=540e9bb2-c81d-4859-ae4b-21f42455c10f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ded5c665f9d14c96a56d04c6468c03fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:26Z,use_quota=True,user_id='247f5d7505e54478be77a02559e21a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8328a6-05ce-4392-8505-4ab8cea6e016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8328a6-05ce-4392-8505-4ab8cea6e016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec9c3c7-2588-4fee-ba5d-e3805e3bff06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec9c3c7-2588-4fee-ba5d-e3805e3bff06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '540e9bb2-c81d-4859-ae4b-21f42455c10f', 'volume_name': 'volume-540e9bb2-c81d-4859-ae4b-21f42455c10f', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5962666-b827-47ab-ade6-1e7adcb9ff78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5962666-b827-47ab-ade6-1e7adcb9ff78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87037f5-b821-432c-8577-cd65e9027e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:26 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Volume 540e9bb2-c81d-4859-ae4b-21f42455c10f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-540e9bb2-c81d-4859-ae4b-21f42455c10f', 'volume_size': 1} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-239112929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=540e9bb2-c81d-4859-ae4b-21f42455c10f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ded5c665f9d14c96a56d04c6468c03fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:26Z,use_quota=True,user_id='247f5d7505e54478be77a02559e21a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Creating volume 540e9bb2-c81d-4859-ae4b-21f42455c10f {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:40:26 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-540e9bb2-c81d-4859-ae4b-21f42455c10f 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:26 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-540e9bb2-c81d-4859-ae4b-21f42455c10f 1073741824 Nov 03 07:40:26 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:26 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-52c4845b-3772-44ec-ae65-9df8bdeac795 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.476s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-52c4845b-3772-44ec-ae65-9df8bdeac795 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:40:26 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-52c4845b-3772-44ec-ae65-9df8bdeac795 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Deleted volume successfully. Nov 03 07:40:26 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-52c4845b-3772-44ec-ae65-9df8bdeac795 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-77626732-f299-407c-8b35-2d05abda1164-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:27 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-44298fd9-afa4-484b-9e2a-d827160ea7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "cinder-dbbef62d-5f9c-47a3-a14a-ca44e1d489db-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:27 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-44298fd9-afa4-484b-9e2a-d827160ea7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-dbbef62d-5f9c-47a3-a14a-ca44e1d489db-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:27 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-44298fd9-afa4-484b-9e2a-d827160ea7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "cinder-quobyte-dbbef62d-5f9c-47a3-a14a-ca44e1d489db" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:27 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-44298fd9-afa4-484b-9e2a-d827160ea7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-quobyte-dbbef62d-5f9c-47a3-a14a-ca44e1d489db" acquired by "delete_volume" :: waited 0.042s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:27 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd170f4-3a77-45f0-998a-c3a4a2048632]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-44298fd9-afa4-484b-9e2a-d827160ea7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dbbef62d-5f9c-47a3-a14a-ca44e1d489db {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:27 devstack sudo[103534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dbbef62d-5f9c-47a3-a14a-ca44e1d489db Nov 03 07:40:27 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:27 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Flow 'volume_create_manager' (89ae43c7-3a46-4342-b167-3d0b4d1a8b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baeb2acf-216f-40cb-9eb1-93a5fd25e64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baeb2acf-216f-40cb-9eb1-93a5fd25e64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a10a62-6681-4da6-8165-39ff57b7544b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a46e081dd45d4d2a873170efa283b257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:28Z,use_quota=True,user_id='2280798c82434c72b7b91ea9a975a9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f00fcd4-625f-4c58-a765-5a1660954f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f00fcd4-625f-4c58-a765-5a1660954f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef101d4a-654e-41a6-9e17-b6ba8b80bb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef101d4a-654e-41a6-9e17-b6ba8b80bb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30a10a62-6681-4da6-8165-39ff57b7544b', 'volume_name': 'volume-30a10a62-6681-4da6-8165-39ff57b7544b', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21054417-cfb0-43a0-9371-2f8872badb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21054417-cfb0-43a0-9371-2f8872badb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad1cdaa-42e9-400b-91cc-dc2f454243c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:27 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Volume 30a10a62-6681-4da6-8165-39ff57b7544b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30a10a62-6681-4da6-8165-39ff57b7544b', 'volume_size': 1} Nov 03 07:40:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:27 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-540e9bb2-c81d-4859-ae4b-21f42455c10f 1073741824" returned: 0 in 1.063s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-540e9bb2-c81d-4859-ae4b-21f42455c10f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:27 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-540e9bb2-c81d-4859-ae4b-21f42455c10f Nov 03 07:40:27 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:27 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-44298fd9-afa4-484b-9e2a-d827160ea7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dbbef62d-5f9c-47a3-a14a-ca44e1d489db" returned: 0 in 0.606s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-44298fd9-afa4-484b-9e2a-d827160ea7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dbbef62d-5f9c-47a3-a14a-ca44e1d489db {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:27 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dbbef62d-5f9c-47a3-a14a-ca44e1d489db Nov 03 07:40:27 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:28 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-540e9bb2-c81d-4859-ae4b-21f42455c10f" returned: 0 in 0.409s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.498s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a10a62-6681-4da6-8165-39ff57b7544b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a46e081dd45d4d2a873170efa283b257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:28Z,use_quota=True,user_id='2280798c82434c72b7b91ea9a975a9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Creating volume 30a10a62-6681-4da6-8165-39ff57b7544b {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:40:28 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-30a10a62-6681-4da6-8165-39ff57b7544b 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:28 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-44298fd9-afa4-484b-9e2a-d827160ea7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dbbef62d-5f9c-47a3-a14a-ca44e1d489db" returned: 0 in 0.336s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87037f5-b821-432c-8577-cd65e9027e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-540e9bb2-c81d-4859-ae4b-21f42455c10f', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a507db-21a2-4c71-a07a-bab4d99df461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:28 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-30a10a62-6681-4da6-8165-39ff57b7544b 1073741824 Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-44298fd9-afa4-484b-9e2a-d827160ea7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-quobyte-dbbef62d-5f9c-47a3-a14a-ca44e1d489db" released by "delete_volume" :: held 1.043s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:28 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:28 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Volume volume-540e9bb2-c81d-4859-ae4b-21f42455c10f (540e9bb2-c81d-4859-ae4b-21f42455c10f): created successfully Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a507db-21a2-4c71-a07a-bab4d99df461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Flow 'volume_create_manager' (4fb5cfb8-f085-41e6-9da2-fb0d0d7b55b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:28 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-21443771-a12f-489b-b0d2-9aafb3edba05 tempest-VolumesTransfersV357Test-470755712 None] Created volume successfully. Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-44298fd9-afa4-484b-9e2a-d827160ea7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Created reservations ['21d353c4-672a-4231-b9f8-4c069ab2b861', '1f0257c5-3589-44e4-8607-595d7d7882e9', '9a69ab64-040d-4511-81e5-329d042b2d3c', '0aaf98cf-23d4-49e6-90c4-7ddd73b16d78'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-44298fd9-afa4-484b-9e2a-d827160ea7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-44298fd9-afa4-484b-9e2a-d827160ea7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-44298fd9-afa4-484b-9e2a-d827160ea7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-44298fd9-afa4-484b-9e2a-d827160ea7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-44298fd9-afa4-484b-9e2a-d827160ea7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-44298fd9-afa4-484b-9e2a-d827160ea7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:28 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:40:28 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:29 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-30a10a62-6681-4da6-8165-39ff57b7544b 1073741824" returned: 0 in 0.874s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:29 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-44298fd9-afa4-484b-9e2a-d827160ea7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.504s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-44298fd9-afa4-484b-9e2a-d827160ea7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:40:29 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-44298fd9-afa4-484b-9e2a-d827160ea7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Deleted volume successfully. Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-30a10a62-6681-4da6-8165-39ff57b7544b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:29 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-30a10a62-6681-4da6-8165-39ff57b7544b Nov 03 07:40:29 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-44298fd9-afa4-484b-9e2a-d827160ea7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-dbbef62d-5f9c-47a3-a14a-ca44e1d489db-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bb023cac-299e-4f7b-b9de-61fccaa1b9ec tempest-VolumesTransfersV357Test-1974385651 None] Acquiring lock "cinder-540e9bb2-c81d-4859-ae4b-21f42455c10f-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bb023cac-299e-4f7b-b9de-61fccaa1b9ec tempest-VolumesTransfersV357Test-1974385651 None] Lock "cinder-540e9bb2-c81d-4859-ae4b-21f42455c10f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bb023cac-299e-4f7b-b9de-61fccaa1b9ec tempest-VolumesTransfersV357Test-1974385651 None] Acquiring lock "cinder-quobyte-540e9bb2-c81d-4859-ae4b-21f42455c10f" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bb023cac-299e-4f7b-b9de-61fccaa1b9ec tempest-VolumesTransfersV357Test-1974385651 None] Lock "cinder-quobyte-540e9bb2-c81d-4859-ae4b-21f42455c10f" acquired by "delete_volume" :: waited 0.019s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b52c5d-dd86-4124-93ee-afe53ab40e2b]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bb023cac-299e-4f7b-b9de-61fccaa1b9ec tempest-VolumesTransfersV357Test-1974385651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-540e9bb2-c81d-4859-ae4b-21f42455c10f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c3d96f9a-57c4-4bba-acd5-01003f79b7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "cinder-db96f670-63d7-47a9-bc6e-ac891b02dac3-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:29 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-30a10a62-6681-4da6-8165-39ff57b7544b" returned: 0 in 0.439s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c3d96f9a-57c4-4bba-acd5-01003f79b7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-db96f670-63d7-47a9-bc6e-ac891b02dac3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c3d96f9a-57c4-4bba-acd5-01003f79b7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "cinder-quobyte-bb1a2b5e-8d3f-453d-9677-f1744434c024" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad1cdaa-42e9-400b-91cc-dc2f454243c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30a10a62-6681-4da6-8165-39ff57b7544b', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf422b6-4d3d-48f2-81d6-8537b9f7307c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c3d96f9a-57c4-4bba-acd5-01003f79b7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-quobyte-bb1a2b5e-8d3f-453d-9677-f1744434c024" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c3d96f9a-57c4-4bba-acd5-01003f79b7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "cinder-quobyte-db96f670-63d7-47a9-bc6e-ac891b02dac3" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:29 devstack sudo[103565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-540e9bb2-c81d-4859-ae4b-21f42455c10f Nov 03 07:40:29 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c3d96f9a-57c4-4bba-acd5-01003f79b7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-quobyte-db96f670-63d7-47a9-bc6e-ac891b02dac3" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-c3d96f9a-57c4-4bba-acd5-01003f79b7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Deleting offline snapshot db96f670-63d7-47a9-bc6e-ac891b02dac3 of volume bb1a2b5e-8d3f-453d-9677-f1744434c024 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-c3d96f9a-57c4-4bba-acd5-01003f79b7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] snapshot_file for this snap is: volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.db96f670-63d7-47a9-bc6e-ac891b02dac3 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:40:29 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Volume volume-30a10a62-6681-4da6-8165-39ff57b7544b (30a10a62-6681-4da6-8165-39ff57b7544b): created successfully Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf422b6-4d3d-48f2-81d6-8537b9f7307c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Flow 'volume_create_manager' (89ae43c7-3a46-4342-b167-3d0b4d1a8b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c976a6b-73c5-436f-939e-0ca6f27048f0]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c3d96f9a-57c4-4bba-acd5-01003f79b7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.db96f670-63d7-47a9-bc6e-ac891b02dac3 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:29 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-9e0b3a23-b0e1-4a2f-9de9-361e4cd53e88 tempest-CinderUnicodeTest-1788331623 None] Created volume successfully. Nov 03 07:40:30 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.db96f670-63d7-47a9-bc6e-ac891b02dac3 Nov 03 07:40:30 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:30 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bb023cac-299e-4f7b-b9de-61fccaa1b9ec tempest-VolumesTransfersV357Test-1974385651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-540e9bb2-c81d-4859-ae4b-21f42455c10f" returned: 0 in 0.593s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bb023cac-299e-4f7b-b9de-61fccaa1b9ec tempest-VolumesTransfersV357Test-1974385651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-540e9bb2-c81d-4859-ae4b-21f42455c10f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:30 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-540e9bb2-c81d-4859-ae4b-21f42455c10f Nov 03 07:40:30 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:30 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c3d96f9a-57c4-4bba-acd5-01003f79b7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.db96f670-63d7-47a9-bc6e-ac891b02dac3" returned: 0 in 0.428s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-c3d96f9a-57c4-4bba-acd5-01003f79b7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb1a2b5e-8d3f-453d-9677-f1744434c024(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:40:30 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7000b1-e0c3-4545-a364-efeb3205a7dd]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c3d96f9a-57c4-4bba-acd5-01003f79b7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:30 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024 Nov 03 07:40:30 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:30 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bb023cac-299e-4f7b-b9de-61fccaa1b9ec tempest-VolumesTransfersV357Test-1974385651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-540e9bb2-c81d-4859-ae4b-21f42455c10f" returned: 0 in 0.290s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bb023cac-299e-4f7b-b9de-61fccaa1b9ec tempest-VolumesTransfersV357Test-1974385651 None] Lock "cinder-quobyte-540e9bb2-c81d-4859-ae4b-21f42455c10f" released by "delete_volume" :: held 0.947s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:30 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-bb023cac-299e-4f7b-b9de-61fccaa1b9ec tempest-VolumesTransfersV357Test-1974385651 None] Created reservations ['f52e02de-6000-4322-8bf2-b1be35547149', '4def6579-3120-4df1-b9c6-a89b1a27567f', '09670baf-5acc-47ee-972f-f4da092e1480', 'ff302e97-e89d-4258-b85a-177e3bc942b3'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-bb023cac-299e-4f7b-b9de-61fccaa1b9ec tempest-VolumesTransfersV357Test-1974385651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-bb023cac-299e-4f7b-b9de-61fccaa1b9ec tempest-VolumesTransfersV357Test-1974385651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-bb023cac-299e-4f7b-b9de-61fccaa1b9ec tempest-VolumesTransfersV357Test-1974385651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-bb023cac-299e-4f7b-b9de-61fccaa1b9ec tempest-VolumesTransfersV357Test-1974385651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-bb023cac-299e-4f7b-b9de-61fccaa1b9ec tempest-VolumesTransfersV357Test-1974385651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bb023cac-299e-4f7b-b9de-61fccaa1b9ec tempest-VolumesTransfersV357Test-1974385651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:30 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:40:30 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:30 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c3d96f9a-57c4-4bba-acd5-01003f79b7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024" returned: 0 in 0.507s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c3d96f9a-57c4-4bba-acd5-01003f79b7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.db96f670-63d7-47a9-bc6e-ac891b02dac3 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:30 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.db96f670-63d7-47a9-bc6e-ac891b02dac3 Nov 03 07:40:30 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:31 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bb023cac-299e-4f7b-b9de-61fccaa1b9ec tempest-VolumesTransfersV357Test-1974385651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.287s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-bb023cac-299e-4f7b-b9de-61fccaa1b9ec tempest-VolumesTransfersV357Test-1974385651 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:40:31 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-bb023cac-299e-4f7b-b9de-61fccaa1b9ec tempest-VolumesTransfersV357Test-1974385651 None] Deleted volume successfully. Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bb023cac-299e-4f7b-b9de-61fccaa1b9ec tempest-VolumesTransfersV357Test-1974385651 None] Lock "cinder-540e9bb2-c81d-4859-ae4b-21f42455c10f-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:31 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c3d96f9a-57c4-4bba-acd5-01003f79b7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.db96f670-63d7-47a9-bc6e-ac891b02dac3" returned: 0 in 0.467s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c3d96f9a-57c4-4bba-acd5-01003f79b7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.db96f670-63d7-47a9-bc6e-ac891b02dac3 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:31 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.db96f670-63d7-47a9-bc6e-ac891b02dac3 Nov 03 07:40:31 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Flow 'volume_create_manager' (a7f0d636-0384-412c-b8a0-da6b2aa59c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae32b59-eb0a-433f-a463-b1eaec37a05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae32b59-eb0a-433f-a463-b1eaec37a05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-684876148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b4057e-1bc2-4849-8ff3-18c5e3b08a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a46e081dd45d4d2a873170efa283b257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:31Z,use_quota=True,user_id='2280798c82434c72b7b91ea9a975a9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf10250-385f-4abc-8654-3ff987da3c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf10250-385f-4abc-8654-3ff987da3c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f7bea0-6503-4465-af77-2f16ecbf78db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f7bea0-6503-4465-af77-2f16ecbf78db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50b4057e-1bc2-4849-8ff3-18c5e3b08a6c', 'volume_name': 'volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15031ed9-1ea6-47f6-a474-0e650fd5e3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15031ed9-1ea6-47f6-a474-0e650fd5e3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b64ab617-c74f-444d-87fb-237fb7ff8ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:31 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Volume 50b4057e-1bc2-4849-8ff3-18c5e3b08a6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c', 'volume_size': 1} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:31 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-684876148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b4057e-1bc2-4849-8ff3-18c5e3b08a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a46e081dd45d4d2a873170efa283b257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:31Z,use_quota=True,user_id='2280798c82434c72b7b91ea9a975a9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Creating volume 50b4057e-1bc2-4849-8ff3-18c5e3b08a6c {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:40:31 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c3d96f9a-57c4-4bba-acd5-01003f79b7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024.db96f670-63d7-47a9-bc6e-ac891b02dac3" returned: 0 in 0.313s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:31 devstack sudo[103598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c 1073741824 Nov 03 07:40:31 devstack sudo[103598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c3d96f9a-57c4-4bba-acd5-01003f79b7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-quobyte-db96f670-63d7-47a9-bc6e-ac891b02dac3" released by "_delete_snapshot" :: held 1.901s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c3d96f9a-57c4-4bba-acd5-01003f79b7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-quobyte-bb1a2b5e-8d3f-453d-9677-f1744434c024" released by "delete_snapshot" :: held 1.958s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-c3d96f9a-57c4-4bba-acd5-01003f79b7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Created reservations ['8382de61-a19b-422d-84d7-5d87dbfe468a', 'e08529b4-04c6-469b-981f-af4625ce69e8', '801cd131-61eb-4f22-91de-98de2ab8ad35', 'e2ff5ee3-4d3c-4ce4-b2cc-ed4d7947c60f'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:31 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-c3d96f9a-57c4-4bba-acd5-01003f79b7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Delete snapshot completed successfully. Nov 03 07:40:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c3d96f9a-57c4-4bba-acd5-01003f79b7c6 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-db96f670-63d7-47a9-bc6e-ac891b02dac3-delete_snapshot" released by "delete_snapshot" :: held 2.221s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:32 devstack sudo[103598]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c 1073741824" returned: 0 in 0.590s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:32 devstack sudo[103604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c Nov 03 07:40:32 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:32 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c" returned: 0 in 0.279s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:32 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:40:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:32 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b64ab617-c74f-444d-87fb-237fb7ff8ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:32 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49536f76-d97d-4a5a-a24e-230c2fcaee17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:32 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Volume volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c (50b4057e-1bc2-4849-8ff3-18c5e3b08a6c): created successfully Nov 03 07:40:32 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49536f76-d97d-4a5a-a24e-230c2fcaee17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:32 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Flow 'volume_create_manager' (a7f0d636-0384-412c-b8a0-da6b2aa59c70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:32 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-831b6d4a-c448-41f4-8aa2-e4140c75df73 tempest-CinderUnicodeTest-1788331623 None] Created volume successfully. Nov 03 07:40:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ec269c6b-480a-4ceb-9622-b6ee338ef728 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "cinder-bb1a2b5e-8d3f-453d-9677-f1744434c024-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ec269c6b-480a-4ceb-9622-b6ee338ef728 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-bb1a2b5e-8d3f-453d-9677-f1744434c024-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ec269c6b-480a-4ceb-9622-b6ee338ef728 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "cinder-quobyte-bb1a2b5e-8d3f-453d-9677-f1744434c024" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ec269c6b-480a-4ceb-9622-b6ee338ef728 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-quobyte-bb1a2b5e-8d3f-453d-9677-f1744434c024" acquired by "delete_volume" :: waited 0.020s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:33 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82722ac-5252-4166-afac-1824e51393ba]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ec269c6b-480a-4ceb-9622-b6ee338ef728 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:33 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024 Nov 03 07:40:33 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:33 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ec269c6b-480a-4ceb-9622-b6ee338ef728 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024" returned: 0 in 0.483s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ec269c6b-480a-4ceb-9622-b6ee338ef728 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:33 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024 Nov 03 07:40:33 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:33 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ec269c6b-480a-4ceb-9622-b6ee338ef728 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-bb1a2b5e-8d3f-453d-9677-f1744434c024" returned: 0 in 0.326s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ec269c6b-480a-4ceb-9622-b6ee338ef728 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-quobyte-bb1a2b5e-8d3f-453d-9677-f1744434c024" released by "delete_volume" :: held 0.898s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:34 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-ec269c6b-480a-4ceb-9622-b6ee338ef728 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Created reservations ['be14a348-70bb-4a39-a44b-05ee3cd8c93c', '4c7ca60d-7afa-4e53-bcbf-4ff7645879dc', '4cf33fb8-1d5e-4ec9-8ccc-045f6d33e528', '3c0cdc61-7c0a-4646-a74d-e0f2eb84a5ea'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1954593e-0b20-456b-8184-bea25b46b08e tempest-CinderUnicodeTest-1788331623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1954593e-0b20-456b-8184-bea25b46b08e tempest-CinderUnicodeTest-1788331623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-1954593e-0b20-456b-8184-bea25b46b08e tempest-CinderUnicodeTest-1788331623 None] Creating offline snapshot 605187bf-05e4-4b1f-9dc4-b3ba4d4c48af of volume 50b4057e-1bc2-4849-8ff3-18c5e3b08a6c {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:40:34 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a778d5-44f1-46fd-8764-42070caac52f]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1954593e-0b20-456b-8184-bea25b46b08e tempest-CinderUnicodeTest-1788331623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ec269c6b-480a-4ceb-9622-b6ee338ef728 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ec269c6b-480a-4ceb-9622-b6ee338ef728 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ec269c6b-480a-4ceb-9622-b6ee338ef728 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ec269c6b-480a-4ceb-9622-b6ee338ef728 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ec269c6b-480a-4ceb-9622-b6ee338ef728 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ec269c6b-480a-4ceb-9622-b6ee338ef728 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:34 devstack sudo[103616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:40:34 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:34 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c Nov 03 07:40:34 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:34 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ec269c6b-480a-4ceb-9622-b6ee338ef728 tempest-CreateVolumesFromSnapshotTest-1775671883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.379s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:34 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-ec269c6b-480a-4ceb-9622-b6ee338ef728 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:40:34 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ec269c6b-480a-4ceb-9622-b6ee338ef728 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Deleted volume successfully. Nov 03 07:40:34 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1954593e-0b20-456b-8184-bea25b46b08e tempest-CinderUnicodeTest-1788331623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c" returned: 0 in 0.522s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1954593e-0b20-456b-8184-bea25b46b08e tempest-CinderUnicodeTest-1788331623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.605187bf-05e4-4b1f-9dc4-b3ba4d4c48af 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:34 devstack sudo[103624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.605187bf-05e4-4b1f-9dc4-b3ba4d4c48af 1G Nov 03 07:40:34 devstack sudo[103624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ec269c6b-480a-4ceb-9622-b6ee338ef728 tempest-CreateVolumesFromSnapshotTest-1775671883 None] Lock "cinder-bb1a2b5e-8d3f-453d-9677-f1744434c024-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:35 devstack sudo[103624]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1954593e-0b20-456b-8184-bea25b46b08e tempest-CinderUnicodeTest-1788331623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.605187bf-05e4-4b1f-9dc4-b3ba4d4c48af 1G" returned: 0 in 0.577s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1954593e-0b20-456b-8184-bea25b46b08e tempest-CinderUnicodeTest-1788331623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.605187bf-05e4-4b1f-9dc4-b3ba4d4c48af {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:35 devstack sudo[103630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.605187bf-05e4-4b1f-9dc4-b3ba4d4c48af Nov 03 07:40:35 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:35 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1954593e-0b20-456b-8184-bea25b46b08e tempest-CinderUnicodeTest-1788331623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.605187bf-05e4-4b1f-9dc4-b3ba4d4c48af" returned: 0 in 0.395s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:35 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-1954593e-0b20-456b-8184-bea25b46b08e tempest-CinderUnicodeTest-1788331623 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.605187bf-05e4-4b1f-9dc4-b3ba4d4c48af is being set with open permissions: ugo+rw Nov 03 07:40:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1954593e-0b20-456b-8184-bea25b46b08e tempest-CinderUnicodeTest-1788331623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.605187bf-05e4-4b1f-9dc4-b3ba4d4c48af {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:35 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.605187bf-05e4-4b1f-9dc4-b3ba4d4c48af Nov 03 07:40:35 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:36 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1954593e-0b20-456b-8184-bea25b46b08e tempest-CinderUnicodeTest-1788331623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.605187bf-05e4-4b1f-9dc4-b3ba4d4c48af" returned: 0 in 0.439s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1954593e-0b20-456b-8184-bea25b46b08e tempest-CinderUnicodeTest-1788331623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:36 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.info Nov 03 07:40:36 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:36 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1954593e-0b20-456b-8184-bea25b46b08e tempest-CinderUnicodeTest-1788331623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.info" returned: 0 in 0.384s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:36 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-1954593e-0b20-456b-8184-bea25b46b08e tempest-CinderUnicodeTest-1788331623 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.info is being set with open permissions: ugo+rw Nov 03 07:40:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1954593e-0b20-456b-8184-bea25b46b08e tempest-CinderUnicodeTest-1788331623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:36 devstack sudo[103641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.info Nov 03 07:40:36 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:37 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1954593e-0b20-456b-8184-bea25b46b08e tempest-CinderUnicodeTest-1788331623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.info" returned: 0 in 0.527s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1954593e-0b20-456b-8184-bea25b46b08e tempest-CinderUnicodeTest-1788331623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.093s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:37 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-1954593e-0b20-456b-8184-bea25b46b08e tempest-CinderUnicodeTest-1788331623 None] Create snapshot completed successfully Nov 03 07:40:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3f883e90-33c9-4a6e-94dd-6646411e8fa7 tempest-CinderUnicodeTest-1788331623 None] Acquiring lock "cinder-605187bf-05e4-4b1f-9dc4-b3ba4d4c48af-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3f883e90-33c9-4a6e-94dd-6646411e8fa7 tempest-CinderUnicodeTest-1788331623 None] Lock "cinder-605187bf-05e4-4b1f-9dc4-b3ba4d4c48af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3f883e90-33c9-4a6e-94dd-6646411e8fa7 tempest-CinderUnicodeTest-1788331623 None] Acquiring lock "cinder-quobyte-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3f883e90-33c9-4a6e-94dd-6646411e8fa7 tempest-CinderUnicodeTest-1788331623 None] Lock "cinder-quobyte-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3f883e90-33c9-4a6e-94dd-6646411e8fa7 tempest-CinderUnicodeTest-1788331623 None] Acquiring lock "cinder-quobyte-605187bf-05e4-4b1f-9dc4-b3ba4d4c48af" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3f883e90-33c9-4a6e-94dd-6646411e8fa7 tempest-CinderUnicodeTest-1788331623 None] Lock "cinder-quobyte-605187bf-05e4-4b1f-9dc4-b3ba4d4c48af" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:38 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-3f883e90-33c9-4a6e-94dd-6646411e8fa7 tempest-CinderUnicodeTest-1788331623 None] Deleting offline snapshot 605187bf-05e4-4b1f-9dc4-b3ba4d4c48af of volume 50b4057e-1bc2-4849-8ff3-18c5e3b08a6c {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:40:38 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-3f883e90-33c9-4a6e-94dd-6646411e8fa7 tempest-CinderUnicodeTest-1788331623 None] snapshot_file for this snap is: volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.605187bf-05e4-4b1f-9dc4-b3ba4d4c48af {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:40:38 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e94274c-da8a-4061-9ff8-7f4585357354]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3f883e90-33c9-4a6e-94dd-6646411e8fa7 tempest-CinderUnicodeTest-1788331623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.605187bf-05e4-4b1f-9dc4-b3ba4d4c48af {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:38 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.605187bf-05e4-4b1f-9dc4-b3ba4d4c48af Nov 03 07:40:38 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:39 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3f883e90-33c9-4a6e-94dd-6646411e8fa7 tempest-CinderUnicodeTest-1788331623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.605187bf-05e4-4b1f-9dc4-b3ba4d4c48af" returned: 0 in 0.524s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-3f883e90-33c9-4a6e-94dd-6646411e8fa7 tempest-CinderUnicodeTest-1788331623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:40:39 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a2bed0-eec9-4feb-a167-d64c0e05aa2d]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3f883e90-33c9-4a6e-94dd-6646411e8fa7 tempest-CinderUnicodeTest-1788331623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:39 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c Nov 03 07:40:39 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:39 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3f883e90-33c9-4a6e-94dd-6646411e8fa7 tempest-CinderUnicodeTest-1788331623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c" returned: 0 in 0.537s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3f883e90-33c9-4a6e-94dd-6646411e8fa7 tempest-CinderUnicodeTest-1788331623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.605187bf-05e4-4b1f-9dc4-b3ba4d4c48af {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:39 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.605187bf-05e4-4b1f-9dc4-b3ba4d4c48af Nov 03 07:40:39 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:40 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3f883e90-33c9-4a6e-94dd-6646411e8fa7 tempest-CinderUnicodeTest-1788331623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.605187bf-05e4-4b1f-9dc4-b3ba4d4c48af" returned: 0 in 0.479s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3f883e90-33c9-4a6e-94dd-6646411e8fa7 tempest-CinderUnicodeTest-1788331623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.605187bf-05e4-4b1f-9dc4-b3ba4d4c48af {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:40 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.605187bf-05e4-4b1f-9dc4-b3ba4d4c48af Nov 03 07:40:40 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:40 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3f883e90-33c9-4a6e-94dd-6646411e8fa7 tempest-CinderUnicodeTest-1788331623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c.605187bf-05e4-4b1f-9dc4-b3ba4d4c48af" returned: 0 in 0.397s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:40 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3f883e90-33c9-4a6e-94dd-6646411e8fa7 tempest-CinderUnicodeTest-1788331623 None] Lock "cinder-quobyte-605187bf-05e4-4b1f-9dc4-b3ba4d4c48af" released by "_delete_snapshot" :: held 2.166s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:40 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3f883e90-33c9-4a6e-94dd-6646411e8fa7 tempest-CinderUnicodeTest-1788331623 None] Lock "cinder-quobyte-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c" released by "delete_snapshot" :: held 2.194s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:40 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-3f883e90-33c9-4a6e-94dd-6646411e8fa7 tempest-CinderUnicodeTest-1788331623 None] Created reservations ['20b848ca-64fa-416a-9c9e-d04b140d48c4', 'cc042f39-750c-446c-9a2f-3db9e3d6c1ce', '5db0dd03-6ace-422c-84fe-93e39aaa7974', 'ab616675-4309-40f2-8688-e916a427b0fc'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:40 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-3f883e90-33c9-4a6e-94dd-6646411e8fa7 tempest-CinderUnicodeTest-1788331623 None] Delete snapshot completed successfully. Nov 03 07:40:40 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3f883e90-33c9-4a6e-94dd-6646411e8fa7 tempest-CinderUnicodeTest-1788331623 None] Lock "cinder-605187bf-05e4-4b1f-9dc4-b3ba4d4c48af-delete_snapshot" released by "delete_snapshot" :: held 2.438s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-33286dbb-3b74-40fa-9a5e-27376b60a19d tempest-CinderUnicodeTest-1788331623 None] Acquiring lock "cinder-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Flow 'volume_create_manager' (42ae06b1-9d7c-45ee-b168-5b627c7b6969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42279448-5848-4d4d-822e-237606383b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-33286dbb-3b74-40fa-9a5e-27376b60a19d tempest-CinderUnicodeTest-1788331623 None] Lock "cinder-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42279448-5848-4d4d-822e-237606383b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-200892735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3172036f-1119-4994-a5b1-d0500c22bddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbca20d0ccb0476fb2695891a80bfa0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:42Z,use_quota=True,user_id='d1ffb6fac266408d8b33396988660b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db8fd52-9fd3-496d-8445-49fe75be9122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db8fd52-9fd3-496d-8445-49fe75be9122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f3ebec8-d72b-4737-ac16-540bb31fc6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f3ebec8-d72b-4737-ac16-540bb31fc6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3172036f-1119-4994-a5b1-d0500c22bddc', 'volume_name': 'volume-3172036f-1119-4994-a5b1-d0500c22bddc', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9610538a-0d78-4d26-be12-b9e64e126a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9610538a-0d78-4d26-be12-b9e64e126a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d457c031-82c8-43e3-9049-92ac9980118f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:41 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Volume 3172036f-1119-4994-a5b1-d0500c22bddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3172036f-1119-4994-a5b1-d0500c22bddc', 'volume_size': 1} Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-200892735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3172036f-1119-4994-a5b1-d0500c22bddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbca20d0ccb0476fb2695891a80bfa0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:42Z,use_quota=True,user_id='d1ffb6fac266408d8b33396988660b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Creating volume 3172036f-1119-4994-a5b1-d0500c22bddc {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:40:41 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:40:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:42 devstack sudo[103693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc 1073741824 Nov 03 07:40:42 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:42 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-33286dbb-3b74-40fa-9a5e-27376b60a19d tempest-CinderUnicodeTest-1788331623 None] Acquiring lock "cinder-quobyte-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:42 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-33286dbb-3b74-40fa-9a5e-27376b60a19d tempest-CinderUnicodeTest-1788331623 None] Lock "cinder-quobyte-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c" acquired by "delete_volume" :: waited 0.020s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:42 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac7bee9-2a48-45bc-93be-84d143ab8024]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-33286dbb-3b74-40fa-9a5e-27376b60a19d tempest-CinderUnicodeTest-1788331623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:42 devstack sudo[103695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c Nov 03 07:40:42 devstack sudo[103695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:42 devstack sudo[103695]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-33286dbb-3b74-40fa-9a5e-27376b60a19d tempest-CinderUnicodeTest-1788331623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c" returned: 0 in 0.458s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-33286dbb-3b74-40fa-9a5e-27376b60a19d tempest-CinderUnicodeTest-1788331623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:42 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc 1073741824" returned: 0 in 0.622s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:42 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c Nov 03 07:40:42 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:42 devstack sudo[103707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc Nov 03 07:40:42 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:42 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-33286dbb-3b74-40fa-9a5e-27376b60a19d tempest-CinderUnicodeTest-1788331623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c" returned: 0 in 0.323s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:42 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-33286dbb-3b74-40fa-9a5e-27376b60a19d tempest-CinderUnicodeTest-1788331623 None] Lock "cinder-quobyte-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c" released by "delete_volume" :: held 0.881s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:42 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc" returned: 0 in 0.280s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:40:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d457c031-82c8-43e3-9049-92ac9980118f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3172036f-1119-4994-a5b1-d0500c22bddc', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d00dfc-9b81-4fb5-b691-b4de0b2e91d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:42 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Volume volume-3172036f-1119-4994-a5b1-d0500c22bddc (3172036f-1119-4994-a5b1-d0500c22bddc): created successfully Nov 03 07:40:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d00dfc-9b81-4fb5-b691-b4de0b2e91d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Flow 'volume_create_manager' (42ae06b1-9d7c-45ee-b168-5b627c7b6969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:43 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-e233d93a-640d-49fb-b09d-25b5ce14adfc tempest-VolumesCloneTest-1186363234 None] Created volume successfully. Nov 03 07:40:43 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-33286dbb-3b74-40fa-9a5e-27376b60a19d tempest-CinderUnicodeTest-1788331623 None] Created reservations ['dcee350c-87f3-46a4-beb3-7cf60351240d', '89b60bc7-3db8-4890-a096-5d7086029582', 'adfe89a5-d2c8-4c49-a9fb-d1c92ddd6e94', '22807183-ca12-4061-bc2f-44d17de5ce91'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-33286dbb-3b74-40fa-9a5e-27376b60a19d tempest-CinderUnicodeTest-1788331623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-33286dbb-3b74-40fa-9a5e-27376b60a19d tempest-CinderUnicodeTest-1788331623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:43 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-33286dbb-3b74-40fa-9a5e-27376b60a19d tempest-CinderUnicodeTest-1788331623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:43 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-33286dbb-3b74-40fa-9a5e-27376b60a19d tempest-CinderUnicodeTest-1788331623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-33286dbb-3b74-40fa-9a5e-27376b60a19d tempest-CinderUnicodeTest-1788331623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-33286dbb-3b74-40fa-9a5e-27376b60a19d tempest-CinderUnicodeTest-1788331623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:43 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:40:43 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:43 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-33286dbb-3b74-40fa-9a5e-27376b60a19d tempest-CinderUnicodeTest-1788331623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.307s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:43 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-33286dbb-3b74-40fa-9a5e-27376b60a19d tempest-CinderUnicodeTest-1788331623 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:40:43 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-33286dbb-3b74-40fa-9a5e-27376b60a19d tempest-CinderUnicodeTest-1788331623 None] Deleted volume successfully. Nov 03 07:40:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-33286dbb-3b74-40fa-9a5e-27376b60a19d tempest-CinderUnicodeTest-1788331623 None] Lock "cinder-50b4057e-1bc2-4849-8ff3-18c5e3b08a6c-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-869c1be1-9c55-48b6-92fc-eb95cb0397bd tempest-CinderUnicodeTest-1788331623 None] Acquiring lock "cinder-30a10a62-6681-4da6-8165-39ff57b7544b-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-869c1be1-9c55-48b6-92fc-eb95cb0397bd tempest-CinderUnicodeTest-1788331623 None] Lock "cinder-30a10a62-6681-4da6-8165-39ff57b7544b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-869c1be1-9c55-48b6-92fc-eb95cb0397bd tempest-CinderUnicodeTest-1788331623 None] Acquiring lock "cinder-quobyte-30a10a62-6681-4da6-8165-39ff57b7544b" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-869c1be1-9c55-48b6-92fc-eb95cb0397bd tempest-CinderUnicodeTest-1788331623 None] Lock "cinder-quobyte-30a10a62-6681-4da6-8165-39ff57b7544b" acquired by "delete_volume" :: waited 0.040s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[61faabe5-10f5-4f77-841d-cb9bc88c943f]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-869c1be1-9c55-48b6-92fc-eb95cb0397bd tempest-CinderUnicodeTest-1788331623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-30a10a62-6681-4da6-8165-39ff57b7544b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:44 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-30a10a62-6681-4da6-8165-39ff57b7544b Nov 03 07:40:44 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Flow 'volume_create_manager' (674c2f40-975a-4e99-8a77-4c7a7f5542a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff126c5-91bb-4061-8d0e-49a3bf18768b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff126c5-91bb-4061-8d0e-49a3bf18768b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1115344513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc810cb0-a054-4353-8b1b-dd0133373ee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbca20d0ccb0476fb2695891a80bfa0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=3172036f-1119-4994-a5b1-d0500c22bddc,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:45Z,use_quota=True,user_id='d1ffb6fac266408d8b33396988660b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72736240-ec04-4985-a16c-3c4829fa2946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72736240-ec04-4985-a16c-3c4829fa2946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc6fe6b-ed63-423b-ae8c-1f61af6b894c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc6fe6b-ed63-423b-ae8c-1f61af6b894c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cc810cb0-a054-4353-8b1b-dd0133373ee2', 'volume_name': 'volume-cc810cb0-a054-4353-8b1b-dd0133373ee2', 'volume_size': 2, 'source_volid': '3172036f-1119-4994-a5b1-d0500c22bddc', 'source_volstatus': 'available'}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b1e351-2adb-4416-b236-322ce207e6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b1e351-2adb-4416-b236-322ce207e6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b56caece-9ac9-4275-97ef-d7b2538cb5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:44 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Volume cc810cb0-a054-4353-8b1b-dd0133373ee2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cc810cb0-a054-4353-8b1b-dd0133373ee2', 'volume_size': 2, 'source_volid': '3172036f-1119-4994-a5b1-d0500c22bddc', 'source_volstatus': 'available'} Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:44 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Cloning volume 3172036f-1119-4994-a5b1-d0500c22bddc to volume cc810cb0-a054-4353-8b1b-dd0133373ee2 Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Creating offline snapshot 93ce52a0-8eb4-47f2-bf39-6db8d91c9e10 of volume 3172036f-1119-4994-a5b1-d0500c22bddc {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[427d7637-62ad-442b-a112-efc8f27e2d22]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:44 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-869c1be1-9c55-48b6-92fc-eb95cb0397bd tempest-CinderUnicodeTest-1788331623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-30a10a62-6681-4da6-8165-39ff57b7544b" returned: 0 in 0.481s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-869c1be1-9c55-48b6-92fc-eb95cb0397bd tempest-CinderUnicodeTest-1788331623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-30a10a62-6681-4da6-8165-39ff57b7544b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:44 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-30a10a62-6681-4da6-8165-39ff57b7544b Nov 03 07:40:44 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:44 devstack sudo[103719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc Nov 03 07:40:44 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:45 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-869c1be1-9c55-48b6-92fc-eb95cb0397bd tempest-CinderUnicodeTest-1788331623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-30a10a62-6681-4da6-8165-39ff57b7544b" returned: 0 in 0.295s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-869c1be1-9c55-48b6-92fc-eb95cb0397bd tempest-CinderUnicodeTest-1788331623 None] Lock "cinder-quobyte-30a10a62-6681-4da6-8165-39ff57b7544b" released by "delete_volume" :: held 0.892s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:45 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-869c1be1-9c55-48b6-92fc-eb95cb0397bd tempest-CinderUnicodeTest-1788331623 None] Created reservations ['cef48ec2-3303-4218-8343-9571c09ac824', '5b356b35-380a-4180-a627-ed7934dbec88', '1c2ec263-a055-4f01-9aa5-77c76ddfe89f', '080e4e44-aa2c-456d-a493-f68903ebbd40'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:45 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc" returned: 0 in 0.452s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.93ce52a0-8eb4-47f2-bf39-6db8d91c9e10 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:45 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.93ce52a0-8eb4-47f2-bf39-6db8d91c9e10 1G Nov 03 07:40:45 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-869c1be1-9c55-48b6-92fc-eb95cb0397bd tempest-CinderUnicodeTest-1788331623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-869c1be1-9c55-48b6-92fc-eb95cb0397bd tempest-CinderUnicodeTest-1788331623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:45 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-869c1be1-9c55-48b6-92fc-eb95cb0397bd tempest-CinderUnicodeTest-1788331623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:45 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-869c1be1-9c55-48b6-92fc-eb95cb0397bd tempest-CinderUnicodeTest-1788331623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-869c1be1-9c55-48b6-92fc-eb95cb0397bd tempest-CinderUnicodeTest-1788331623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-869c1be1-9c55-48b6-92fc-eb95cb0397bd tempest-CinderUnicodeTest-1788331623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:45 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:40:45 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:45 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-869c1be1-9c55-48b6-92fc-eb95cb0397bd tempest-CinderUnicodeTest-1788331623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.310s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:45 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-869c1be1-9c55-48b6-92fc-eb95cb0397bd tempest-CinderUnicodeTest-1788331623 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:40:45 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-869c1be1-9c55-48b6-92fc-eb95cb0397bd tempest-CinderUnicodeTest-1788331623 None] Deleted volume successfully. Nov 03 07:40:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-869c1be1-9c55-48b6-92fc-eb95cb0397bd tempest-CinderUnicodeTest-1788331623 None] Lock "cinder-30a10a62-6681-4da6-8165-39ff57b7544b-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:45 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.93ce52a0-8eb4-47f2-bf39-6db8d91c9e10 1G" returned: 0 in 0.507s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3172036f-1119-4994-a5b1-d0500c22bddc -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.93ce52a0-8eb4-47f2-bf39-6db8d91c9e10 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:45 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3172036f-1119-4994-a5b1-d0500c22bddc -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.93ce52a0-8eb4-47f2-bf39-6db8d91c9e10 Nov 03 07:40:45 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:46 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3172036f-1119-4994-a5b1-d0500c22bddc -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.93ce52a0-8eb4-47f2-bf39-6db8d91c9e10" returned: 0 in 0.323s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:46 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.93ce52a0-8eb4-47f2-bf39-6db8d91c9e10 is being set with open permissions: ugo+rw Nov 03 07:40:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.93ce52a0-8eb4-47f2-bf39-6db8d91c9e10 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:46 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.93ce52a0-8eb4-47f2-bf39-6db8d91c9e10 Nov 03 07:40:46 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:46 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.93ce52a0-8eb4-47f2-bf39-6db8d91c9e10" returned: 0 in 0.270s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:46 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.info Nov 03 07:40:46 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:46 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.info" returned: 0 in 0.298s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:46 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.info is being set with open permissions: ugo+rw Nov 03 07:40:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:46 devstack sudo[103747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.info Nov 03 07:40:46 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:46 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.info" returned: 0 in 0.282s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:47 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Acquiring lock "cinder-quobyte-cc810cb0-a054-4353-8b1b-dd0133373ee2" by "_copy_volume_from_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:47 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Lock "cinder-quobyte-cc810cb0-a054-4353-8b1b-dd0133373ee2" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] snapshot: 93ce52a0-8eb4-47f2-bf39-6db8d91c9e10, volume: cc810cb0-a054-4353-8b1b-dd0133373ee2, {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:40:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:47 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[130be10b-6ca4-47dc-9f36-bde2e3bb25ac]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.93ce52a0-8eb4-47f2-bf39-6db8d91c9e10 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:47 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.93ce52a0-8eb4-47f2-bf39-6db8d91c9e10 Nov 03 07:40:47 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:47 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.93ce52a0-8eb4-47f2-bf39-6db8d91c9e10" returned: 0 in 0.419s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3172036f-1119-4994-a5b1-d0500c22bddc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:40:47 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[82323fdc-5778-4cd4-bdcc-4e4c77a32698]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:47 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc Nov 03 07:40:47 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:47 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc" returned: 0 in 0.467s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:40:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Creating direct copy from snapshot {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:40:47 devstack cinder-volume[87016]: DEBUG cinder.utils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Path /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc810cb0-a054-4353-8b1b-dd0133373ee2 not found in is_blk_device check {{(pid=87016) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 07:40:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc810cb0-a054-4353-8b1b-dd0133373ee2 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:48 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc810cb0-a054-4353-8b1b-dd0133373ee2 Nov 03 07:40:48 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:40:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:49 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:40:49 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:49 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.612s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:40:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:40:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 28 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:40:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:40:55 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc810cb0-a054-4353-8b1b-dd0133373ee2" returned: 0 in 7.753s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:55 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Image conversion details: src /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc, size 1024.00 MB, duration 7.75 sec, destination /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc810cb0-a054-4353-8b1b-dd0133373ee2 {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:40:55 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Converted 1024.00 MB image at 132.05 MB/s Nov 03 07:40:55 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc810cb0-a054-4353-8b1b-dd0133373ee2 is being set with open permissions: ugo+rw Nov 03 07:40:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc810cb0-a054-4353-8b1b-dd0133373ee2 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:55 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc810cb0-a054-4353-8b1b-dd0133373ee2 Nov 03 07:40:55 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:55 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc810cb0-a054-4353-8b1b-dd0133373ee2" returned: 0 in 0.248s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:56 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Lock "cinder-quobyte-cc810cb0-a054-4353-8b1b-dd0133373ee2" released by "_copy_volume_from_snapshot" :: held 8.980s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:56 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Acquiring lock "cinder-quobyte-93ce52a0-8eb4-47f2-bf39-6db8d91c9e10" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:56 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Lock "cinder-quobyte-93ce52a0-8eb4-47f2-bf39-6db8d91c9e10" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Deleting offline snapshot 93ce52a0-8eb4-47f2-bf39-6db8d91c9e10 of volume 3172036f-1119-4994-a5b1-d0500c22bddc {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:40:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] snapshot_file for this snap is: volume-3172036f-1119-4994-a5b1-d0500c22bddc.93ce52a0-8eb4-47f2-bf39-6db8d91c9e10 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:40:56 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc11c50-88b0-49f6-8576-cfd543718968]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.93ce52a0-8eb4-47f2-bf39-6db8d91c9e10 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:56 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.93ce52a0-8eb4-47f2-bf39-6db8d91c9e10 Nov 03 07:40:56 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:56 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=114,cinder:UPDATE=138,cinder:INSERT=45,cinder:DELETE=12 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:40:56 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.93ce52a0-8eb4-47f2-bf39-6db8d91c9e10" returned: 0 in 0.398s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3172036f-1119-4994-a5b1-d0500c22bddc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:40:56 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f58602-3559-4cc5-94c5-842b1e4319e9]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:56 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc Nov 03 07:40:56 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:57 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc" returned: 0 in 0.549s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.93ce52a0-8eb4-47f2-bf39-6db8d91c9e10 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:57 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.93ce52a0-8eb4-47f2-bf39-6db8d91c9e10 Nov 03 07:40:57 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:57 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.93ce52a0-8eb4-47f2-bf39-6db8d91c9e10" returned: 0 in 0.365s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.93ce52a0-8eb4-47f2-bf39-6db8d91c9e10 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:57 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.93ce52a0-8eb4-47f2-bf39-6db8d91c9e10 Nov 03 07:40:57 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:57 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc.93ce52a0-8eb4-47f2-bf39-6db8d91c9e10" returned: 0 in 0.271s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Lock "cinder-quobyte-93ce52a0-8eb4-47f2-bf39-6db8d91c9e10" released by "_delete_snapshot" :: held 1.681s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.047s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b56caece-9ac9-4275-97ef-d7b2538cb5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc810cb0-a054-4353-8b1b-dd0133373ee2', 'volume_size': 2, 'source_volid': '3172036f-1119-4994-a5b1-d0500c22bddc', 'source_volstatus': 'available'}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6386f28-1d5e-4b62-b089-be12b3a76606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:57 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Volume volume-cc810cb0-a054-4353-8b1b-dd0133373ee2 (cc810cb0-a054-4353-8b1b-dd0133373ee2): created successfully Nov 03 07:40:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6386f28-1d5e-4b62-b089-be12b3a76606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Flow 'volume_create_manager' (674c2f40-975a-4e99-8a77-4c7a7f5542a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:57 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-c159104e-95e3-402c-80ff-c53c6bf13bde tempest-VolumesCloneTest-1186363234 None] Created volume successfully. Nov 03 07:40:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-efed44f6-3572-4a6c-90f4-d34b6f396436 tempest-VolumesCloneTest-1186363234 None] Acquiring lock "cinder-cc810cb0-a054-4353-8b1b-dd0133373ee2-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-efed44f6-3572-4a6c-90f4-d34b6f396436 tempest-VolumesCloneTest-1186363234 None] Lock "cinder-cc810cb0-a054-4353-8b1b-dd0133373ee2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-efed44f6-3572-4a6c-90f4-d34b6f396436 tempest-VolumesCloneTest-1186363234 None] Acquiring lock "cinder-quobyte-cc810cb0-a054-4353-8b1b-dd0133373ee2" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-efed44f6-3572-4a6c-90f4-d34b6f396436 tempest-VolumesCloneTest-1186363234 None] Lock "cinder-quobyte-cc810cb0-a054-4353-8b1b-dd0133373ee2" acquired by "delete_volume" :: waited 0.016s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:59 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4d4c44-fe76-49de-ae7b-cf0c6af223de]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-efed44f6-3572-4a6c-90f4-d34b6f396436 tempest-VolumesCloneTest-1186363234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc810cb0-a054-4353-8b1b-dd0133373ee2 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:59 devstack sudo[103801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc810cb0-a054-4353-8b1b-dd0133373ee2 Nov 03 07:40:59 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:59 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-efed44f6-3572-4a6c-90f4-d34b6f396436 tempest-VolumesCloneTest-1186363234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc810cb0-a054-4353-8b1b-dd0133373ee2" returned: 0 in 0.386s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-efed44f6-3572-4a6c-90f4-d34b6f396436 tempest-VolumesCloneTest-1186363234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc810cb0-a054-4353-8b1b-dd0133373ee2 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:59 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc810cb0-a054-4353-8b1b-dd0133373ee2 Nov 03 07:40:59 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:00 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-efed44f6-3572-4a6c-90f4-d34b6f396436 tempest-VolumesCloneTest-1186363234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-cc810cb0-a054-4353-8b1b-dd0133373ee2" returned: 0 in 0.264s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-efed44f6-3572-4a6c-90f4-d34b6f396436 tempest-VolumesCloneTest-1186363234 None] Lock "cinder-quobyte-cc810cb0-a054-4353-8b1b-dd0133373ee2" released by "delete_volume" :: held 0.694s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:00 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-efed44f6-3572-4a6c-90f4-d34b6f396436 tempest-VolumesCloneTest-1186363234 None] Created reservations ['72e1995d-b062-4318-9606-bdfed020bfbe', 'acc44d36-38d4-4b46-bca9-34e9772027bd', 'b6ae7874-eff2-4dc6-8106-e6f83e1883d3', '7bc24ecb-ac7b-4d2c-a68c-e6df69ec8b9e'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-efed44f6-3572-4a6c-90f4-d34b6f396436 tempest-VolumesCloneTest-1186363234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-efed44f6-3572-4a6c-90f4-d34b6f396436 tempest-VolumesCloneTest-1186363234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-efed44f6-3572-4a6c-90f4-d34b6f396436 tempest-VolumesCloneTest-1186363234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-efed44f6-3572-4a6c-90f4-d34b6f396436 tempest-VolumesCloneTest-1186363234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-efed44f6-3572-4a6c-90f4-d34b6f396436 tempest-VolumesCloneTest-1186363234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-efed44f6-3572-4a6c-90f4-d34b6f396436 tempest-VolumesCloneTest-1186363234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:00 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:41:00 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:00 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-efed44f6-3572-4a6c-90f4-d34b6f396436 tempest-VolumesCloneTest-1186363234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.269s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:00 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-efed44f6-3572-4a6c-90f4-d34b6f396436 tempest-VolumesCloneTest-1186363234 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:00 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-efed44f6-3572-4a6c-90f4-d34b6f396436 tempest-VolumesCloneTest-1186363234 None] Deleted volume successfully. Nov 03 07:41:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-efed44f6-3572-4a6c-90f4-d34b6f396436 tempest-VolumesCloneTest-1186363234 None] Lock "cinder-cc810cb0-a054-4353-8b1b-dd0133373ee2-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-001a4eb6-89ca-4bcb-a1f8-8d0f9045e1a0 tempest-VolumesCloneTest-1186363234 None] Acquiring lock "cinder-3172036f-1119-4994-a5b1-d0500c22bddc-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-001a4eb6-89ca-4bcb-a1f8-8d0f9045e1a0 tempest-VolumesCloneTest-1186363234 None] Lock "cinder-3172036f-1119-4994-a5b1-d0500c22bddc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-001a4eb6-89ca-4bcb-a1f8-8d0f9045e1a0 tempest-VolumesCloneTest-1186363234 None] Acquiring lock "cinder-quobyte-3172036f-1119-4994-a5b1-d0500c22bddc" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-001a4eb6-89ca-4bcb-a1f8-8d0f9045e1a0 tempest-VolumesCloneTest-1186363234 None] Lock "cinder-quobyte-3172036f-1119-4994-a5b1-d0500c22bddc" acquired by "delete_volume" :: waited 0.015s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:00 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffb4ba8-7f3e-40a0-8bfd-ff5a314ebd9d]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-001a4eb6-89ca-4bcb-a1f8-8d0f9045e1a0 tempest-VolumesCloneTest-1186363234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:00 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc Nov 03 07:41:00 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:01 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-001a4eb6-89ca-4bcb-a1f8-8d0f9045e1a0 tempest-VolumesCloneTest-1186363234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc" returned: 0 in 0.383s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-001a4eb6-89ca-4bcb-a1f8-8d0f9045e1a0 tempest-VolumesCloneTest-1186363234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:01 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc Nov 03 07:41:01 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:01 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-001a4eb6-89ca-4bcb-a1f8-8d0f9045e1a0 tempest-VolumesCloneTest-1186363234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3172036f-1119-4994-a5b1-d0500c22bddc" returned: 0 in 0.309s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-001a4eb6-89ca-4bcb-a1f8-8d0f9045e1a0 tempest-VolumesCloneTest-1186363234 None] Lock "cinder-quobyte-3172036f-1119-4994-a5b1-d0500c22bddc" released by "delete_volume" :: held 0.765s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:01 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-001a4eb6-89ca-4bcb-a1f8-8d0f9045e1a0 tempest-VolumesCloneTest-1186363234 None] Created reservations ['aeaa82e6-f3ce-4669-a01d-e761a16bf7ec', 'c45c65b0-3349-488d-a315-1bca4d13c044', '9299c1c0-1bf8-4756-ab46-273521f8ec67', '2e0527d5-a4cf-4674-986e-1a61bb087640'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-001a4eb6-89ca-4bcb-a1f8-8d0f9045e1a0 tempest-VolumesCloneTest-1186363234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-001a4eb6-89ca-4bcb-a1f8-8d0f9045e1a0 tempest-VolumesCloneTest-1186363234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:01 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-001a4eb6-89ca-4bcb-a1f8-8d0f9045e1a0 tempest-VolumesCloneTest-1186363234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:01 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-001a4eb6-89ca-4bcb-a1f8-8d0f9045e1a0 tempest-VolumesCloneTest-1186363234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-001a4eb6-89ca-4bcb-a1f8-8d0f9045e1a0 tempest-VolumesCloneTest-1186363234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-001a4eb6-89ca-4bcb-a1f8-8d0f9045e1a0 tempest-VolumesCloneTest-1186363234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:01 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:41:01 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:01 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-001a4eb6-89ca-4bcb-a1f8-8d0f9045e1a0 tempest-VolumesCloneTest-1186363234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.309s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:01 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-001a4eb6-89ca-4bcb-a1f8-8d0f9045e1a0 tempest-VolumesCloneTest-1186363234 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:01 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-001a4eb6-89ca-4bcb-a1f8-8d0f9045e1a0 tempest-VolumesCloneTest-1186363234 None] Deleted volume successfully. Nov 03 07:41:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-001a4eb6-89ca-4bcb-a1f8-8d0f9045e1a0 tempest-VolumesCloneTest-1186363234 None] Lock "cinder-3172036f-1119-4994-a5b1-d0500c22bddc-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:04 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=125,cinder:UPDATE=161,cinder:INSERT=37,cinder:DELETE=14 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:41:04 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-155b0c0b-ee6c-40c6-ba6a-8807f6614aeb req-30567f4d-d8fe-4e6b-8245-51a800bd7740 tempest-TestShelveInstance-990178793 None] Terminate volume connection completed successfully. Nov 03 07:41:04 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-155b0c0b-ee6c-40c6-ba6a-8807f6614aeb req-30567f4d-d8fe-4e6b-8245-51a800bd7740 tempest-TestShelveInstance-990178793 None] Deleting attachment e7803c4d-0817-4872-81b3-783976e13850. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:41:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-155b0c0b-ee6c-40c6-ba6a-8807f6614aeb req-bf57022e-d1e7-47bf-a3b9-3633f516f64d tempest-TestShelveInstance-990178793 None] Acquiring lock "cinder-ca19b950-bc27-4166-8815-5b3c332e269a-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-155b0c0b-ee6c-40c6-ba6a-8807f6614aeb req-bf57022e-d1e7-47bf-a3b9-3633f516f64d tempest-TestShelveInstance-990178793 None] Lock "cinder-ca19b950-bc27-4166-8815-5b3c332e269a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-155b0c0b-ee6c-40c6-ba6a-8807f6614aeb req-bf57022e-d1e7-47bf-a3b9-3633f516f64d tempest-TestShelveInstance-990178793 None] Acquiring lock "cinder-quobyte-ca19b950-bc27-4166-8815-5b3c332e269a" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-155b0c0b-ee6c-40c6-ba6a-8807f6614aeb req-bf57022e-d1e7-47bf-a3b9-3633f516f64d tempest-TestShelveInstance-990178793 None] Lock "cinder-quobyte-ca19b950-bc27-4166-8815-5b3c332e269a" acquired by "delete_volume" :: waited 0.021s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:04 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dfc409-32a1-4cab-baaa-10c1cd8db4c9]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-155b0c0b-ee6c-40c6-ba6a-8807f6614aeb req-bf57022e-d1e7-47bf-a3b9-3633f516f64d tempest-TestShelveInstance-990178793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ca19b950-bc27-4166-8815-5b3c332e269a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:04 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ca19b950-bc27-4166-8815-5b3c332e269a Nov 03 07:41:04 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:05 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-155b0c0b-ee6c-40c6-ba6a-8807f6614aeb req-bf57022e-d1e7-47bf-a3b9-3633f516f64d tempest-TestShelveInstance-990178793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ca19b950-bc27-4166-8815-5b3c332e269a" returned: 0 in 0.504s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-155b0c0b-ee6c-40c6-ba6a-8807f6614aeb req-bf57022e-d1e7-47bf-a3b9-3633f516f64d tempest-TestShelveInstance-990178793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ca19b950-bc27-4166-8815-5b3c332e269a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:05 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ca19b950-bc27-4166-8815-5b3c332e269a Nov 03 07:41:05 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:05 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-155b0c0b-ee6c-40c6-ba6a-8807f6614aeb req-bf57022e-d1e7-47bf-a3b9-3633f516f64d tempest-TestShelveInstance-990178793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ca19b950-bc27-4166-8815-5b3c332e269a" returned: 0 in 0.338s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-155b0c0b-ee6c-40c6-ba6a-8807f6614aeb req-bf57022e-d1e7-47bf-a3b9-3633f516f64d tempest-TestShelveInstance-990178793 None] Lock "cinder-quobyte-ca19b950-bc27-4166-8815-5b3c332e269a" released by "delete_volume" :: held 0.927s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:05 devstack cinder-volume[87016]: DEBUG cinder.quota [req-155b0c0b-ee6c-40c6-ba6a-8807f6614aeb req-bf57022e-d1e7-47bf-a3b9-3633f516f64d tempest-TestShelveInstance-990178793 None] Created reservations ['9819eab4-90f6-4b10-a870-68e057db1fb3', '059046b1-ca19-4ea6-bfa7-3b8f628198b1', '1eb302b6-11cd-4b0a-8486-ae8101ec06ee', '5609faf1-07eb-4839-b99f-b65c9d0d4367'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-155b0c0b-ee6c-40c6-ba6a-8807f6614aeb req-bf57022e-d1e7-47bf-a3b9-3633f516f64d tempest-TestShelveInstance-990178793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-155b0c0b-ee6c-40c6-ba6a-8807f6614aeb req-bf57022e-d1e7-47bf-a3b9-3633f516f64d tempest-TestShelveInstance-990178793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [req-155b0c0b-ee6c-40c6-ba6a-8807f6614aeb req-bf57022e-d1e7-47bf-a3b9-3633f516f64d tempest-TestShelveInstance-990178793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [req-155b0c0b-ee6c-40c6-ba6a-8807f6614aeb req-bf57022e-d1e7-47bf-a3b9-3633f516f64d tempest-TestShelveInstance-990178793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-155b0c0b-ee6c-40c6-ba6a-8807f6614aeb req-bf57022e-d1e7-47bf-a3b9-3633f516f64d tempest-TestShelveInstance-990178793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-155b0c0b-ee6c-40c6-ba6a-8807f6614aeb req-bf57022e-d1e7-47bf-a3b9-3633f516f64d tempest-TestShelveInstance-990178793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:05 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:41:05 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:06 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [req-155b0c0b-ee6c-40c6-ba6a-8807f6614aeb req-bf57022e-d1e7-47bf-a3b9-3633f516f64d tempest-TestShelveInstance-990178793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.353s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:06 devstack cinder-volume[87016]: DEBUG cinder.manager [req-155b0c0b-ee6c-40c6-ba6a-8807f6614aeb req-bf57022e-d1e7-47bf-a3b9-3633f516f64d tempest-TestShelveInstance-990178793 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:06 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-155b0c0b-ee6c-40c6-ba6a-8807f6614aeb req-bf57022e-d1e7-47bf-a3b9-3633f516f64d tempest-TestShelveInstance-990178793 None] Deleted volume successfully. Nov 03 07:41:06 devstack cinder-volume[87016]: DEBUG cinder.coordination [req-155b0c0b-ee6c-40c6-ba6a-8807f6614aeb req-bf57022e-d1e7-47bf-a3b9-3633f516f64d tempest-TestShelveInstance-990178793 None] Lock "cinder-ca19b950-bc27-4166-8815-5b3c332e269a-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:07 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Flow 'volume_create_manager' (99094a0e-648d-44b3-9284-e619948108ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c0d9f3b-2ce1-40c6-88cb-6942bda51455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c0d9f3b-2ce1-40c6-88cb-6942bda51455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1193075710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=129a8573-3369-4692-a04f-b04942bd8eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2adeacb070744fc90c61b42d0b75117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:08Z,use_quota=True,user_id='a9fe7ce068714fce88b2a0f0efa1c311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4adedea6-7805-4341-8c26-f7c607426983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4adedea6-7805-4341-8c26-f7c607426983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9420c4d1-ca55-484d-9d30-4706577b7ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9420c4d1-ca55-484d-9d30-4706577b7ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '129a8573-3369-4692-a04f-b04942bd8eaf', 'volume_name': 'volume-129a8573-3369-4692-a04f-b04942bd8eaf', 'volume_size': 2}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f6bd18-c1cf-40c3-8bc4-dbe9ed3e09dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f6bd18-c1cf-40c3-8bc4-dbe9ed3e09dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a7c7db8-df44-4e14-aa75-5f7edf3029f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:07 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Volume 129a8573-3369-4692-a04f-b04942bd8eaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-129a8573-3369-4692-a04f-b04942bd8eaf', 'volume_size': 2} Nov 03 07:41:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:07 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1193075710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=129a8573-3369-4692-a04f-b04942bd8eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2adeacb070744fc90c61b42d0b75117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:08Z,use_quota=True,user_id='a9fe7ce068714fce88b2a0f0efa1c311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:41:07 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Creating volume 129a8573-3369-4692-a04f-b04942bd8eaf {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:07 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:07 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:07 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:07 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:41:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf 2147483648 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:07 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf 2147483648 Nov 03 07:41:07 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:08 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf 2147483648" returned: 0 in 0.529s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:08 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf Nov 03 07:41:08 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:08 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf" returned: 0 in 0.301s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:41:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a7c7db8-df44-4e14-aa75-5f7edf3029f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-129a8573-3369-4692-a04f-b04942bd8eaf', 'volume_size': 2}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a5ecde-80d5-45b1-8893-edb57e75a62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:08 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Volume volume-129a8573-3369-4692-a04f-b04942bd8eaf (129a8573-3369-4692-a04f-b04942bd8eaf): created successfully Nov 03 07:41:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a5ecde-80d5-45b1-8893-edb57e75a62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Flow 'volume_create_manager' (99094a0e-648d-44b3-9284-e619948108ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:08 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-aa9125ee-97d8-43eb-8a99-32ebe44685ae tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Created volume successfully. Nov 03 07:41:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-eba12e82-7e4c-44f8-ae4f-2445d54b4fde tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-eba12e82-7e4c-44f8-ae4f-2445d54b4fde tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-eba12e82-7e4c-44f8-ae4f-2445d54b4fde tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Creating offline snapshot fec0b9ce-688b-4388-9812-ef6edc0fcc1b of volume 129a8573-3369-4692-a04f-b04942bd8eaf {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:41:10 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[496fcdfd-aa07-4463-84fc-fc6ffb1896b8]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-eba12e82-7e4c-44f8-ae4f-2445d54b4fde tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:10 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf Nov 03 07:41:10 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:10 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-eba12e82-7e4c-44f8-ae4f-2445d54b4fde tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf" returned: 0 in 0.485s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-eba12e82-7e4c-44f8-ae4f-2445d54b4fde tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.fec0b9ce-688b-4388-9812-ef6edc0fcc1b 2G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:10 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.fec0b9ce-688b-4388-9812-ef6edc0fcc1b 2G Nov 03 07:41:10 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:11 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-eba12e82-7e4c-44f8-ae4f-2445d54b4fde tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.fec0b9ce-688b-4388-9812-ef6edc0fcc1b 2G" returned: 0 in 0.616s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-eba12e82-7e4c-44f8-ae4f-2445d54b4fde tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129a8573-3369-4692-a04f-b04942bd8eaf -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.fec0b9ce-688b-4388-9812-ef6edc0fcc1b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:11 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129a8573-3369-4692-a04f-b04942bd8eaf -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.fec0b9ce-688b-4388-9812-ef6edc0fcc1b Nov 03 07:41:11 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:11 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-eba12e82-7e4c-44f8-ae4f-2445d54b4fde tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129a8573-3369-4692-a04f-b04942bd8eaf -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.fec0b9ce-688b-4388-9812-ef6edc0fcc1b" returned: 0 in 0.355s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:11 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-eba12e82-7e4c-44f8-ae4f-2445d54b4fde tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.fec0b9ce-688b-4388-9812-ef6edc0fcc1b is being set with open permissions: ugo+rw Nov 03 07:41:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-eba12e82-7e4c-44f8-ae4f-2445d54b4fde tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.fec0b9ce-688b-4388-9812-ef6edc0fcc1b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:11 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.fec0b9ce-688b-4388-9812-ef6edc0fcc1b Nov 03 07:41:11 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:11 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-eba12e82-7e4c-44f8-ae4f-2445d54b4fde tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.fec0b9ce-688b-4388-9812-ef6edc0fcc1b" returned: 0 in 0.262s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-eba12e82-7e4c-44f8-ae4f-2445d54b4fde tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:11 devstack sudo[103894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.info Nov 03 07:41:11 devstack sudo[103894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:12 devstack sudo[103894]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-eba12e82-7e4c-44f8-ae4f-2445d54b4fde tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.info" returned: 0 in 0.348s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:12 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-eba12e82-7e4c-44f8-ae4f-2445d54b4fde tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.info is being set with open permissions: ugo+rw Nov 03 07:41:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-eba12e82-7e4c-44f8-ae4f-2445d54b4fde tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:12 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.info Nov 03 07:41:12 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:12 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-eba12e82-7e4c-44f8-ae4f-2445d54b4fde tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.info" returned: 0 in 0.262s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-eba12e82-7e4c-44f8-ae4f-2445d54b4fde tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.430s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:12 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-eba12e82-7e4c-44f8-ae4f-2445d54b4fde tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Create snapshot completed successfully Nov 03 07:41:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cbc0928a-9e92-43c4-8c19-7efd643ac4f6 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Acquiring lock "cinder-fec0b9ce-688b-4388-9812-ef6edc0fcc1b-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cbc0928a-9e92-43c4-8c19-7efd643ac4f6 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Lock "cinder-fec0b9ce-688b-4388-9812-ef6edc0fcc1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cbc0928a-9e92-43c4-8c19-7efd643ac4f6 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Acquiring lock "cinder-quobyte-129a8573-3369-4692-a04f-b04942bd8eaf" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cbc0928a-9e92-43c4-8c19-7efd643ac4f6 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Lock "cinder-quobyte-129a8573-3369-4692-a04f-b04942bd8eaf" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cbc0928a-9e92-43c4-8c19-7efd643ac4f6 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Acquiring lock "cinder-quobyte-fec0b9ce-688b-4388-9812-ef6edc0fcc1b" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cbc0928a-9e92-43c4-8c19-7efd643ac4f6 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Lock "cinder-quobyte-fec0b9ce-688b-4388-9812-ef6edc0fcc1b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-cbc0928a-9e92-43c4-8c19-7efd643ac4f6 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Deleting offline snapshot fec0b9ce-688b-4388-9812-ef6edc0fcc1b of volume 129a8573-3369-4692-a04f-b04942bd8eaf {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:41:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-cbc0928a-9e92-43c4-8c19-7efd643ac4f6 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] snapshot_file for this snap is: volume-129a8573-3369-4692-a04f-b04942bd8eaf.fec0b9ce-688b-4388-9812-ef6edc0fcc1b {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:41:13 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[170efedc-866f-401c-9ae9-63b7e13e676c]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cbc0928a-9e92-43c4-8c19-7efd643ac4f6 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.fec0b9ce-688b-4388-9812-ef6edc0fcc1b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:13 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.fec0b9ce-688b-4388-9812-ef6edc0fcc1b Nov 03 07:41:13 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:13 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cbc0928a-9e92-43c4-8c19-7efd643ac4f6 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.fec0b9ce-688b-4388-9812-ef6edc0fcc1b" returned: 0 in 0.429s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-cbc0928a-9e92-43c4-8c19-7efd643ac4f6 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-129a8573-3369-4692-a04f-b04942bd8eaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:41:14 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[1944485d-6674-4007-a623-23545e6274d1]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cbc0928a-9e92-43c4-8c19-7efd643ac4f6 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:14 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf Nov 03 07:41:14 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:14 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cbc0928a-9e92-43c4-8c19-7efd643ac4f6 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf" returned: 0 in 0.401s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cbc0928a-9e92-43c4-8c19-7efd643ac4f6 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.fec0b9ce-688b-4388-9812-ef6edc0fcc1b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:14 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.fec0b9ce-688b-4388-9812-ef6edc0fcc1b Nov 03 07:41:14 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:14 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cbc0928a-9e92-43c4-8c19-7efd643ac4f6 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.fec0b9ce-688b-4388-9812-ef6edc0fcc1b" returned: 0 in 0.350s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cbc0928a-9e92-43c4-8c19-7efd643ac4f6 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.fec0b9ce-688b-4388-9812-ef6edc0fcc1b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:14 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.fec0b9ce-688b-4388-9812-ef6edc0fcc1b Nov 03 07:41:14 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:15 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cbc0928a-9e92-43c4-8c19-7efd643ac4f6 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf.fec0b9ce-688b-4388-9812-ef6edc0fcc1b" returned: 0 in 0.273s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cbc0928a-9e92-43c4-8c19-7efd643ac4f6 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Lock "cinder-quobyte-fec0b9ce-688b-4388-9812-ef6edc0fcc1b" released by "_delete_snapshot" :: held 1.606s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cbc0928a-9e92-43c4-8c19-7efd643ac4f6 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Lock "cinder-quobyte-129a8573-3369-4692-a04f-b04942bd8eaf" released by "delete_snapshot" :: held 1.650s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:15 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-cbc0928a-9e92-43c4-8c19-7efd643ac4f6 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Created reservations ['88954d39-0324-4948-9962-e8389b35b467', '6bd6d2dc-1b29-47c0-bb1c-b90066f00737', 'c9ca79fd-6db9-4793-a461-5d03ca3759ed', 'f3b51673-6e0c-4a5e-8501-3011314bbd87'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:15 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-cbc0928a-9e92-43c4-8c19-7efd643ac4f6 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Delete snapshot completed successfully. Nov 03 07:41:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cbc0928a-9e92-43c4-8c19-7efd643ac4f6 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Lock "cinder-fec0b9ce-688b-4388-9812-ef6edc0fcc1b-delete_snapshot" released by "delete_snapshot" :: held 1.889s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bf0e94f3-1aff-4023-8114-6d65a7927ef0 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Acquiring lock "cinder-129a8573-3369-4692-a04f-b04942bd8eaf-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bf0e94f3-1aff-4023-8114-6d65a7927ef0 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Lock "cinder-129a8573-3369-4692-a04f-b04942bd8eaf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bf0e94f3-1aff-4023-8114-6d65a7927ef0 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Acquiring lock "cinder-quobyte-129a8573-3369-4692-a04f-b04942bd8eaf" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bf0e94f3-1aff-4023-8114-6d65a7927ef0 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Lock "cinder-quobyte-129a8573-3369-4692-a04f-b04942bd8eaf" acquired by "delete_volume" :: waited 0.020s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:15 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[577226e4-3967-443c-bf20-3ad037a5c0b1]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bf0e94f3-1aff-4023-8114-6d65a7927ef0 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:15 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf Nov 03 07:41:15 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:16 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bf0e94f3-1aff-4023-8114-6d65a7927ef0 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf" returned: 0 in 0.454s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bf0e94f3-1aff-4023-8114-6d65a7927ef0 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:16 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf Nov 03 07:41:16 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:16 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bf0e94f3-1aff-4023-8114-6d65a7927ef0 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-129a8573-3369-4692-a04f-b04942bd8eaf" returned: 0 in 0.292s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:16 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bf0e94f3-1aff-4023-8114-6d65a7927ef0 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Lock "cinder-quobyte-129a8573-3369-4692-a04f-b04942bd8eaf" released by "delete_volume" :: held 0.822s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:16 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-bf0e94f3-1aff-4023-8114-6d65a7927ef0 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Created reservations ['f6b28d7e-92a5-4535-b630-b3b8f41efbdb', 'b78c5e56-2724-4a2f-8bc2-19046fb5bf8b', 'c12a55dd-b32d-45c1-b7e0-167f1f339f91', '336aa1b0-e0af-48ab-9561-4817b7703ec7'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-bf0e94f3-1aff-4023-8114-6d65a7927ef0 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-bf0e94f3-1aff-4023-8114-6d65a7927ef0 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-bf0e94f3-1aff-4023-8114-6d65a7927ef0 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-bf0e94f3-1aff-4023-8114-6d65a7927ef0 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-bf0e94f3-1aff-4023-8114-6d65a7927ef0 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bf0e94f3-1aff-4023-8114-6d65a7927ef0 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:16 devstack sudo[103928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:41:16 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:17 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bf0e94f3-1aff-4023-8114-6d65a7927ef0 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.310s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:17 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-bf0e94f3-1aff-4023-8114-6d65a7927ef0 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:17 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-bf0e94f3-1aff-4023-8114-6d65a7927ef0 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Deleted volume successfully. Nov 03 07:41:17 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bf0e94f3-1aff-4023-8114-6d65a7927ef0 tempest-VolumesSnapshotNegativeTestJSON-1029849925 None] Lock "cinder-129a8573-3369-4692-a04f-b04942bd8eaf-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Flow 'volume_create_manager' (f960f20e-4459-4208-ae00-430b065fc865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b1647fe-087a-4ba3-a161-7103ee625f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b1647fe-087a-4ba3-a161-7103ee625f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1579564766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24126ce-78cf-4a44-b94c-3ae82fdb052b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458be11693284c069c31ff706529b2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:21Z,use_quota=True,user_id='0a96b29b12c74a67a5774b2a825e7518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a2f8da-ca32-43c7-af4c-c9834b491bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a2f8da-ca32-43c7-af4c-c9834b491bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bc405f5-ba97-4ec8-a125-31444abbc38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bc405f5-ba97-4ec8-a125-31444abbc38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c24126ce-78cf-4a44-b94c-3ae82fdb052b', 'volume_name': 'volume-c24126ce-78cf-4a44-b94c-3ae82fdb052b', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83995049-15d4-4678-bc24-d0826def6ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83995049-15d4-4678-bc24-d0826def6ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bd111c6-1b5a-4908-983a-b32131ca4ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:21 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Volume c24126ce-78cf-4a44-b94c-3ae82fdb052b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c24126ce-78cf-4a44-b94c-3ae82fdb052b', 'volume_size': 1} Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1579564766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24126ce-78cf-4a44-b94c-3ae82fdb052b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458be11693284c069c31ff706529b2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:21Z,use_quota=True,user_id='0a96b29b12c74a67a5774b2a825e7518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Creating volume c24126ce-78cf-4a44-b94c-3ae82fdb052b {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:21 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c24126ce-78cf-4a44-b94c-3ae82fdb052b 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:21 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c24126ce-78cf-4a44-b94c-3ae82fdb052b 1073741824 Nov 03 07:41:21 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:21 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c24126ce-78cf-4a44-b94c-3ae82fdb052b 1073741824" returned: 0 in 0.520s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c24126ce-78cf-4a44-b94c-3ae82fdb052b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:21 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c24126ce-78cf-4a44-b94c-3ae82fdb052b Nov 03 07:41:21 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:22 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c24126ce-78cf-4a44-b94c-3ae82fdb052b" returned: 0 in 0.342s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:22 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:41:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bd111c6-1b5a-4908-983a-b32131ca4ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24126ce-78cf-4a44-b94c-3ae82fdb052b', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a368d4-8b3a-40ec-a53c-27b40678ad10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:22 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Volume volume-c24126ce-78cf-4a44-b94c-3ae82fdb052b (c24126ce-78cf-4a44-b94c-3ae82fdb052b): created successfully Nov 03 07:41:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a368d4-8b3a-40ec-a53c-27b40678ad10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:22 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Flow 'volume_create_manager' (f960f20e-4459-4208-ae00-430b065fc865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:22 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-593be0ca-d4ab-46bc-8d36-59e4061fa068 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Created volume successfully. Nov 03 07:41:23 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Flow 'volume_create_manager' (625724da-7015-49eb-a35c-36f9b31815ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1235271-d670-480f-9b92-1196b3bf2e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1235271-d670-480f-9b92-1196b3bf2e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095769484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f148a037-6f9e-4314-bcc7-b02d1a7e9f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458be11693284c069c31ff706529b2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:24Z,use_quota=True,user_id='0a96b29b12c74a67a5774b2a825e7518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf491e7-60cd-455b-bd9f-c7c588cd3277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf491e7-60cd-455b-bd9f-c7c588cd3277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58848d62-748a-4845-971a-52f98478c96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58848d62-748a-4845-971a-52f98478c96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f148a037-6f9e-4314-bcc7-b02d1a7e9f63', 'volume_name': 'volume-f148a037-6f9e-4314-bcc7-b02d1a7e9f63', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a453ac-2905-4d09-89ab-1474c9a0500a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a453ac-2905-4d09-89ab-1474c9a0500a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:23 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99df6305-8980-44d5-8403-28445a3ba263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:23 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Volume f148a037-6f9e-4314-bcc7-b02d1a7e9f63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f148a037-6f9e-4314-bcc7-b02d1a7e9f63', 'volume_size': 1} Nov 03 07:41:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095769484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f148a037-6f9e-4314-bcc7-b02d1a7e9f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458be11693284c069c31ff706529b2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:24Z,use_quota=True,user_id='0a96b29b12c74a67a5774b2a825e7518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:41:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Creating volume f148a037-6f9e-4314-bcc7-b02d1a7e9f63 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:23 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:41:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f148a037-6f9e-4314-bcc7-b02d1a7e9f63 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:24 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f148a037-6f9e-4314-bcc7-b02d1a7e9f63 1073741824 Nov 03 07:41:24 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:24 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Flow 'volume_create_manager' (4134475f-43e8-48e6-87e8-e5133358066f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8715f80c-b32b-4ada-9174-dc79ba74e4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8715f80c-b32b-4ada-9174-dc79ba74e4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-355832010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c8432d9-b3f4-4f8c-ad17-caee830bc66c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458be11693284c069c31ff706529b2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:24Z,use_quota=True,user_id='0a96b29b12c74a67a5774b2a825e7518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262595ac-8b16-4dc4-8213-c28fd334193a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262595ac-8b16-4dc4-8213-c28fd334193a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2360f9b2-99e2-41ac-b0a8-d2b48be82d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2360f9b2-99e2-41ac-b0a8-d2b48be82d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c8432d9-b3f4-4f8c-ad17-caee830bc66c', 'volume_name': 'volume-4c8432d9-b3f4-4f8c-ad17-caee830bc66c', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f212b43-da17-4ff3-b2f1-6aafe0616711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f212b43-da17-4ff3-b2f1-6aafe0616711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:24 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebd48e6-977d-4f2f-80c5-2a736240eb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:24 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Volume 4c8432d9-b3f4-4f8c-ad17-caee830bc66c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c8432d9-b3f4-4f8c-ad17-caee830bc66c', 'volume_size': 1} Nov 03 07:41:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:24 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f148a037-6f9e-4314-bcc7-b02d1a7e9f63 1073741824" returned: 0 in 0.821s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f148a037-6f9e-4314-bcc7-b02d1a7e9f63 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:24 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f148a037-6f9e-4314-bcc7-b02d1a7e9f63 Nov 03 07:41:24 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:24 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Flow 'volume_create_manager' (a3bb87dd-6a68-498f-a05d-044dc68456f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722fd9bf-4536-48fc-9422-381d93d8ea6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722fd9bf-4536-48fc-9422-381d93d8ea6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-648519385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b042b5-1e2b-411d-9f90-1a746c660071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458be11693284c069c31ff706529b2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:25Z,use_quota=True,user_id='0a96b29b12c74a67a5774b2a825e7518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e01e55-af2f-4124-a040-dc28ef394593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e01e55-af2f-4124-a040-dc28ef394593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf31e7b-53b4-484c-8a1a-5609d8b45829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf31e7b-53b4-484c-8a1a-5609d8b45829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71b042b5-1e2b-411d-9f90-1a746c660071', 'volume_name': 'volume-71b042b5-1e2b-411d-9f90-1a746c660071', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f051e4b-61bf-4746-9955-c94fa8fdbb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f051e4b-61bf-4746-9955-c94fa8fdbb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6259967-1799-4841-8691-1f79c816face) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:25 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Volume 71b042b5-1e2b-411d-9f90-1a746c660071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71b042b5-1e2b-411d-9f90-1a746c660071', 'volume_size': 1} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:25 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f148a037-6f9e-4314-bcc7-b02d1a7e9f63" returned: 0 in 0.428s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.684s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-355832010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c8432d9-b3f4-4f8c-ad17-caee830bc66c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458be11693284c069c31ff706529b2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:24Z,use_quota=True,user_id='0a96b29b12c74a67a5774b2a825e7518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Creating volume 4c8432d9-b3f4-4f8c-ad17-caee830bc66c {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:25 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c8432d9-b3f4-4f8c-ad17-caee830bc66c 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99df6305-8980-44d5-8403-28445a3ba263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f148a037-6f9e-4314-bcc7-b02d1a7e9f63', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:25 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c8432d9-b3f4-4f8c-ad17-caee830bc66c 1073741824 Nov 03 07:41:25 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8787f704-5843-4b3d-bd79-bf22e7475505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:25 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Volume volume-f148a037-6f9e-4314-bcc7-b02d1a7e9f63 (f148a037-6f9e-4314-bcc7-b02d1a7e9f63): created successfully Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8787f704-5843-4b3d-bd79-bf22e7475505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Flow 'volume_create_manager' (625724da-7015-49eb-a35c-36f9b31815ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Flow 'volume_create_manager' (00281930-cecc-4bb4-a784-7466a62ae6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c60760d-8ef2-4a54-8cc9-5de69512fc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:25 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-dfaf7392-cb5a-43c1-b5f5-a5641bbeb441 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Created volume successfully. Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c60760d-8ef2-4a54-8cc9-5de69512fc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-32204596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=277295fb-da91-40e5-b31e-578da39fd21d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458be11693284c069c31ff706529b2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:25Z,use_quota=True,user_id='0a96b29b12c74a67a5774b2a825e7518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5798977-f1a1-4f24-9515-83b73acd1408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5798977-f1a1-4f24-9515-83b73acd1408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84444cff-d351-48a0-9b07-a325a401da75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84444cff-d351-48a0-9b07-a325a401da75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '277295fb-da91-40e5-b31e-578da39fd21d', 'volume_name': 'volume-277295fb-da91-40e5-b31e-578da39fd21d', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1fecf5-b9e7-4379-ac65-0d31a16225eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1fecf5-b9e7-4379-ac65-0d31a16225eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da459977-ecb4-4b78-b742-b66133dd9715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:25 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Volume 277295fb-da91-40e5-b31e-578da39fd21d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-277295fb-da91-40e5-b31e-578da39fd21d', 'volume_size': 1} Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:25 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c8432d9-b3f4-4f8c-ad17-caee830bc66c 1073741824" returned: 0 in 0.650s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Flow 'volume_create_manager' (14f768e2-a135-49fc-a326-c2df52b96419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139e0a45-9fca-46cc-8ef9-6a82d8e1806e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c8432d9-b3f4-4f8c-ad17-caee830bc66c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139e0a45-9fca-46cc-8ef9-6a82d8e1806e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-403766297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f59dd6f6-dc13-4614-8a91-297829a9fb23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458be11693284c069c31ff706529b2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:26Z,use_quota=True,user_id='0a96b29b12c74a67a5774b2a825e7518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa8f8ca-9374-4358-aa48-414c2bd32a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa8f8ca-9374-4358-aa48-414c2bd32a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:26 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c8432d9-b3f4-4f8c-ad17-caee830bc66c Nov 03 07:41:26 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4edb9d33-5d79-48ad-98cb-9eb9ecee627e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4edb9d33-5d79-48ad-98cb-9eb9ecee627e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f59dd6f6-dc13-4614-8a91-297829a9fb23', 'volume_name': 'volume-f59dd6f6-dc13-4614-8a91-297829a9fb23', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea4b8da1-1dbb-41d0-b4a0-e7a53dec6a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea4b8da1-1dbb-41d0-b4a0-e7a53dec6a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15abf80-9bee-466d-a96f-f5aff8b5ec24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:26 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Volume f59dd6f6-dc13-4614-8a91-297829a9fb23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f59dd6f6-dc13-4614-8a91-297829a9fb23', 'volume_size': 1} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:26 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c8432d9-b3f4-4f8c-ad17-caee830bc66c" returned: 0 in 0.324s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.297s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-648519385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b042b5-1e2b-411d-9f90-1a746c660071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458be11693284c069c31ff706529b2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:25Z,use_quota=True,user_id='0a96b29b12c74a67a5774b2a825e7518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Creating volume 71b042b5-1e2b-411d-9f90-1a746c660071 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:26 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-71b042b5-1e2b-411d-9f90-1a746c660071 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebd48e6-977d-4f2f-80c5-2a736240eb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c8432d9-b3f4-4f8c-ad17-caee830bc66c', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16291761-e05c-4841-b089-6d3ee0cc28eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:26 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-71b042b5-1e2b-411d-9f90-1a746c660071 1073741824 Nov 03 07:41:26 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:26 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Volume volume-4c8432d9-b3f4-4f8c-ad17-caee830bc66c (4c8432d9-b3f4-4f8c-ad17-caee830bc66c): created successfully Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16291761-e05c-4841-b089-6d3ee0cc28eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Flow 'volume_create_manager' (4134475f-43e8-48e6-87e8-e5133358066f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:26 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-f64b826e-f8ab-421d-b6b9-5afa6091bc56 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Created volume successfully. Nov 03 07:41:27 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-71b042b5-1e2b-411d-9f90-1a746c660071 1073741824" returned: 0 in 0.599s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-71b042b5-1e2b-411d-9f90-1a746c660071 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:27 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-71b042b5-1e2b-411d-9f90-1a746c660071 Nov 03 07:41:27 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:27 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-71b042b5-1e2b-411d-9f90-1a746c660071" returned: 0 in 0.302s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:41:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.665s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-32204596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=277295fb-da91-40e5-b31e-578da39fd21d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458be11693284c069c31ff706529b2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:25Z,use_quota=True,user_id='0a96b29b12c74a67a5774b2a825e7518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:41:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Creating volume 277295fb-da91-40e5-b31e-578da39fd21d {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:27 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:41:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-277295fb-da91-40e5-b31e-578da39fd21d 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6259967-1799-4841-8691-1f79c816face) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71b042b5-1e2b-411d-9f90-1a746c660071', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5431b9-ac4e-404a-b89f-5c9bab77d9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:27 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-277295fb-da91-40e5-b31e-578da39fd21d 1073741824 Nov 03 07:41:27 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:27 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Volume volume-71b042b5-1e2b-411d-9f90-1a746c660071 (71b042b5-1e2b-411d-9f90-1a746c660071): created successfully Nov 03 07:41:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5431b9-ac4e-404a-b89f-5c9bab77d9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Flow 'volume_create_manager' (a3bb87dd-6a68-498f-a05d-044dc68456f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:27 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-6d6093af-7179-4c66-ad10-8991a8494f1f tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Created volume successfully. Nov 03 07:41:28 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-277295fb-da91-40e5-b31e-578da39fd21d 1073741824" returned: 0 in 0.630s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-277295fb-da91-40e5-b31e-578da39fd21d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:28 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-277295fb-da91-40e5-b31e-578da39fd21d Nov 03 07:41:28 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:28 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-277295fb-da91-40e5-b31e-578da39fd21d" returned: 0 in 0.316s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:41:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.242s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-403766297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f59dd6f6-dc13-4614-8a91-297829a9fb23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458be11693284c069c31ff706529b2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:26Z,use_quota=True,user_id='0a96b29b12c74a67a5774b2a825e7518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:41:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Creating volume f59dd6f6-dc13-4614-8a91-297829a9fb23 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:28 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:41:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f59dd6f6-dc13-4614-8a91-297829a9fb23 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da459977-ecb4-4b78-b742-b66133dd9715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-277295fb-da91-40e5-b31e-578da39fd21d', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:28 devstack sudo[104020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f59dd6f6-dc13-4614-8a91-297829a9fb23 1073741824 Nov 03 07:41:28 devstack sudo[104020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f495a3-c91b-4a7b-a7a6-036c58483369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:28 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Volume volume-277295fb-da91-40e5-b31e-578da39fd21d (277295fb-da91-40e5-b31e-578da39fd21d): created successfully Nov 03 07:41:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f495a3-c91b-4a7b-a7a6-036c58483369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Flow 'volume_create_manager' (00281930-cecc-4bb4-a784-7466a62ae6d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:28 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-cd96b427-e844-4f15-a8c1-f39f7aa66b29 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Created volume successfully. Nov 03 07:41:29 devstack sudo[104020]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f59dd6f6-dc13-4614-8a91-297829a9fb23 1073741824" returned: 0 in 0.628s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f59dd6f6-dc13-4614-8a91-297829a9fb23 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:29 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f59dd6f6-dc13-4614-8a91-297829a9fb23 Nov 03 07:41:29 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:29 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f59dd6f6-dc13-4614-8a91-297829a9fb23" returned: 0 in 0.358s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:41:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15abf80-9bee-466d-a96f-f5aff8b5ec24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f59dd6f6-dc13-4614-8a91-297829a9fb23', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e727f116-0163-4527-a5c5-0bcfecdd4c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:29 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Volume volume-f59dd6f6-dc13-4614-8a91-297829a9fb23 (f59dd6f6-dc13-4614-8a91-297829a9fb23): created successfully Nov 03 07:41:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e727f116-0163-4527-a5c5-0bcfecdd4c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Flow 'volume_create_manager' (14f768e2-a135-49fc-a326-c2df52b96419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:29 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-6575140f-5bcb-4db6-95a4-65e62573deee tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Created volume successfully. Nov 03 07:41:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-03514308-8bbe-4b80-b312-d1288f61a115 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "cinder-f59dd6f6-dc13-4614-8a91-297829a9fb23-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-03514308-8bbe-4b80-b312-d1288f61a115 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-f59dd6f6-dc13-4614-8a91-297829a9fb23-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-03514308-8bbe-4b80-b312-d1288f61a115 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "cinder-quobyte-f59dd6f6-dc13-4614-8a91-297829a9fb23" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-03514308-8bbe-4b80-b312-d1288f61a115 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-quobyte-f59dd6f6-dc13-4614-8a91-297829a9fb23" acquired by "delete_volume" :: waited 0.022s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:30 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[f362edae-a473-4227-a281-81d00db7928d]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-03514308-8bbe-4b80-b312-d1288f61a115 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f59dd6f6-dc13-4614-8a91-297829a9fb23 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:30 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f59dd6f6-dc13-4614-8a91-297829a9fb23 Nov 03 07:41:30 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:31 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-03514308-8bbe-4b80-b312-d1288f61a115 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f59dd6f6-dc13-4614-8a91-297829a9fb23" returned: 0 in 0.456s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-03514308-8bbe-4b80-b312-d1288f61a115 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f59dd6f6-dc13-4614-8a91-297829a9fb23 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:31 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f59dd6f6-dc13-4614-8a91-297829a9fb23 Nov 03 07:41:31 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:31 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-03514308-8bbe-4b80-b312-d1288f61a115 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f59dd6f6-dc13-4614-8a91-297829a9fb23" returned: 0 in 0.289s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-03514308-8bbe-4b80-b312-d1288f61a115 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-quobyte-f59dd6f6-dc13-4614-8a91-297829a9fb23" released by "delete_volume" :: held 0.800s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:31 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-03514308-8bbe-4b80-b312-d1288f61a115 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Created reservations ['01671660-74dc-434b-a8e4-954d6deb5e31', '54f2d689-1acb-426d-a6ba-341e45d12a27', 'b60903ab-fc4e-4b56-9ddd-b6e04dbb13ae', 'ec1cffcf-6ef7-4eeb-8a90-95decd8c38ba'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-03514308-8bbe-4b80-b312-d1288f61a115 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-03514308-8bbe-4b80-b312-d1288f61a115 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:31 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-03514308-8bbe-4b80-b312-d1288f61a115 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:31 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-03514308-8bbe-4b80-b312-d1288f61a115 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-03514308-8bbe-4b80-b312-d1288f61a115 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-03514308-8bbe-4b80-b312-d1288f61a115 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:31 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:41:31 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-653b4edc-6537-4819-b7f0-1c128089840c tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "cinder-277295fb-da91-40e5-b31e-578da39fd21d-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-653b4edc-6537-4819-b7f0-1c128089840c tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-277295fb-da91-40e5-b31e-578da39fd21d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-653b4edc-6537-4819-b7f0-1c128089840c tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "cinder-quobyte-277295fb-da91-40e5-b31e-578da39fd21d" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-653b4edc-6537-4819-b7f0-1c128089840c tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-quobyte-277295fb-da91-40e5-b31e-578da39fd21d" acquired by "delete_volume" :: waited 0.027s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:32 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe759dcb-d077-4044-b895-93689093ac2e]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-653b4edc-6537-4819-b7f0-1c128089840c tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-277295fb-da91-40e5-b31e-578da39fd21d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:32 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-03514308-8bbe-4b80-b312-d1288f61a115 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.347s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:32 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-03514308-8bbe-4b80-b312-d1288f61a115 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:32 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-03514308-8bbe-4b80-b312-d1288f61a115 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Deleted volume successfully. Nov 03 07:41:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-03514308-8bbe-4b80-b312-d1288f61a115 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-f59dd6f6-dc13-4614-8a91-297829a9fb23-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:32 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-277295fb-da91-40e5-b31e-578da39fd21d Nov 03 07:41:32 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:32 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-653b4edc-6537-4819-b7f0-1c128089840c tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-277295fb-da91-40e5-b31e-578da39fd21d" returned: 0 in 0.491s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-653b4edc-6537-4819-b7f0-1c128089840c tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-277295fb-da91-40e5-b31e-578da39fd21d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:32 devstack sudo[104049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-277295fb-da91-40e5-b31e-578da39fd21d Nov 03 07:41:32 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:32 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-653b4edc-6537-4819-b7f0-1c128089840c tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-277295fb-da91-40e5-b31e-578da39fd21d" returned: 0 in 0.328s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-653b4edc-6537-4819-b7f0-1c128089840c tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-quobyte-277295fb-da91-40e5-b31e-578da39fd21d" released by "delete_volume" :: held 0.918s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:32 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-653b4edc-6537-4819-b7f0-1c128089840c tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Created reservations ['e4d8f8e6-ff91-4209-a11e-c764ea7ec523', '0866c1bd-a4c7-4219-81a0-502cb0b62c2b', '1f570511-8c7b-4451-a2cb-e014c682fb8f', 'b763e051-cf89-4d8a-bfa8-cef8bc3c422e'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-653b4edc-6537-4819-b7f0-1c128089840c tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-653b4edc-6537-4819-b7f0-1c128089840c tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-653b4edc-6537-4819-b7f0-1c128089840c tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-653b4edc-6537-4819-b7f0-1c128089840c tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-653b4edc-6537-4819-b7f0-1c128089840c tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-653b4edc-6537-4819-b7f0-1c128089840c tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:33 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:41:33 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:33 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-653b4edc-6537-4819-b7f0-1c128089840c tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.314s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:33 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-653b4edc-6537-4819-b7f0-1c128089840c tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:33 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-653b4edc-6537-4819-b7f0-1c128089840c tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Deleted volume successfully. Nov 03 07:41:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-653b4edc-6537-4819-b7f0-1c128089840c tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-277295fb-da91-40e5-b31e-578da39fd21d-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1916fbb1-ed99-493e-b54c-aa3e5e071921 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "cinder-71b042b5-1e2b-411d-9f90-1a746c660071-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1916fbb1-ed99-493e-b54c-aa3e5e071921 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-71b042b5-1e2b-411d-9f90-1a746c660071-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1916fbb1-ed99-493e-b54c-aa3e5e071921 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "cinder-quobyte-71b042b5-1e2b-411d-9f90-1a746c660071" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1916fbb1-ed99-493e-b54c-aa3e5e071921 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-quobyte-71b042b5-1e2b-411d-9f90-1a746c660071" acquired by "delete_volume" :: waited 0.022s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:34 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[59382864-fcaf-4a0b-8791-f8dede5f02b9]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1916fbb1-ed99-493e-b54c-aa3e5e071921 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-71b042b5-1e2b-411d-9f90-1a746c660071 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:34 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-71b042b5-1e2b-411d-9f90-1a746c660071 Nov 03 07:41:34 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:34 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1916fbb1-ed99-493e-b54c-aa3e5e071921 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-71b042b5-1e2b-411d-9f90-1a746c660071" returned: 0 in 0.443s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1916fbb1-ed99-493e-b54c-aa3e5e071921 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-71b042b5-1e2b-411d-9f90-1a746c660071 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:34 devstack sudo[104060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-71b042b5-1e2b-411d-9f90-1a746c660071 Nov 03 07:41:34 devstack sudo[104060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:35 devstack sudo[104060]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1916fbb1-ed99-493e-b54c-aa3e5e071921 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-71b042b5-1e2b-411d-9f90-1a746c660071" returned: 0 in 0.349s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1916fbb1-ed99-493e-b54c-aa3e5e071921 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-quobyte-71b042b5-1e2b-411d-9f90-1a746c660071" released by "delete_volume" :: held 0.854s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:35 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-1916fbb1-ed99-493e-b54c-aa3e5e071921 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Created reservations ['84c80fdd-6c02-4a49-b199-79bc79323c80', 'c49d81a4-8983-4392-8ac1-a34a2dcb4430', '3a3253d8-2270-4569-8d53-db6466ddf9df', 'a2d3750b-a3ef-4e03-8941-cbe633120cd6'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1916fbb1-ed99-493e-b54c-aa3e5e071921 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1916fbb1-ed99-493e-b54c-aa3e5e071921 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1916fbb1-ed99-493e-b54c-aa3e5e071921 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1916fbb1-ed99-493e-b54c-aa3e5e071921 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1916fbb1-ed99-493e-b54c-aa3e5e071921 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1916fbb1-ed99-493e-b54c-aa3e5e071921 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:35 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:41:35 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a7624a11-0eec-4269-b444-a058136d1476 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "cinder-4c8432d9-b3f4-4f8c-ad17-caee830bc66c-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a7624a11-0eec-4269-b444-a058136d1476 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-4c8432d9-b3f4-4f8c-ad17-caee830bc66c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a7624a11-0eec-4269-b444-a058136d1476 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "cinder-quobyte-4c8432d9-b3f4-4f8c-ad17-caee830bc66c" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a7624a11-0eec-4269-b444-a058136d1476 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-quobyte-4c8432d9-b3f4-4f8c-ad17-caee830bc66c" acquired by "delete_volume" :: waited 0.023s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:35 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[979a40b0-c42b-47bc-9f19-e7b048b6d000]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a7624a11-0eec-4269-b444-a058136d1476 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c8432d9-b3f4-4f8c-ad17-caee830bc66c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:35 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1916fbb1-ed99-493e-b54c-aa3e5e071921 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.359s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:35 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-1916fbb1-ed99-493e-b54c-aa3e5e071921 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:35 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-1916fbb1-ed99-493e-b54c-aa3e5e071921 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Deleted volume successfully. Nov 03 07:41:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1916fbb1-ed99-493e-b54c-aa3e5e071921 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-71b042b5-1e2b-411d-9f90-1a746c660071-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:35 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c8432d9-b3f4-4f8c-ad17-caee830bc66c Nov 03 07:41:35 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:36 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a7624a11-0eec-4269-b444-a058136d1476 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c8432d9-b3f4-4f8c-ad17-caee830bc66c" returned: 0 in 0.569s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a7624a11-0eec-4269-b444-a058136d1476 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c8432d9-b3f4-4f8c-ad17-caee830bc66c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:36 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c8432d9-b3f4-4f8c-ad17-caee830bc66c Nov 03 07:41:36 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:36 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a7624a11-0eec-4269-b444-a058136d1476 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4c8432d9-b3f4-4f8c-ad17-caee830bc66c" returned: 0 in 0.330s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a7624a11-0eec-4269-b444-a058136d1476 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-quobyte-4c8432d9-b3f4-4f8c-ad17-caee830bc66c" released by "delete_volume" :: held 0.964s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:36 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-a7624a11-0eec-4269-b444-a058136d1476 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Created reservations ['36b92d01-9404-4594-9a63-0ec0d37b5a58', 'c60e973a-d611-40b8-a1c5-ed1b334dd556', '83d94676-5e88-49ef-88ff-3f23e3795217', '75124c6d-67f1-4a39-b207-ddc190be40c8'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a7624a11-0eec-4269-b444-a058136d1476 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a7624a11-0eec-4269-b444-a058136d1476 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:36 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a7624a11-0eec-4269-b444-a058136d1476 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:36 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a7624a11-0eec-4269-b444-a058136d1476 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a7624a11-0eec-4269-b444-a058136d1476 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a7624a11-0eec-4269-b444-a058136d1476 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:36 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:41:36 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:36 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a7624a11-0eec-4269-b444-a058136d1476 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.312s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:36 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a7624a11-0eec-4269-b444-a058136d1476 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:36 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a7624a11-0eec-4269-b444-a058136d1476 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Deleted volume successfully. Nov 03 07:41:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a7624a11-0eec-4269-b444-a058136d1476 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-4c8432d9-b3f4-4f8c-ad17-caee830bc66c-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2df45b4f-511c-4fa5-b24f-1823398a0f71 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "cinder-f148a037-6f9e-4314-bcc7-b02d1a7e9f63-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2df45b4f-511c-4fa5-b24f-1823398a0f71 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-f148a037-6f9e-4314-bcc7-b02d1a7e9f63-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2df45b4f-511c-4fa5-b24f-1823398a0f71 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "cinder-quobyte-f148a037-6f9e-4314-bcc7-b02d1a7e9f63" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2df45b4f-511c-4fa5-b24f-1823398a0f71 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-quobyte-f148a037-6f9e-4314-bcc7-b02d1a7e9f63" acquired by "delete_volume" :: waited 0.022s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:37 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1bf5d4-755a-429f-bea0-3bc2c4803bae]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2df45b4f-511c-4fa5-b24f-1823398a0f71 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f148a037-6f9e-4314-bcc7-b02d1a7e9f63 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:37 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f148a037-6f9e-4314-bcc7-b02d1a7e9f63 Nov 03 07:41:37 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:38 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2df45b4f-511c-4fa5-b24f-1823398a0f71 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f148a037-6f9e-4314-bcc7-b02d1a7e9f63" returned: 0 in 0.428s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2df45b4f-511c-4fa5-b24f-1823398a0f71 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f148a037-6f9e-4314-bcc7-b02d1a7e9f63 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:38 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f148a037-6f9e-4314-bcc7-b02d1a7e9f63 Nov 03 07:41:38 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:38 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2df45b4f-511c-4fa5-b24f-1823398a0f71 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f148a037-6f9e-4314-bcc7-b02d1a7e9f63" returned: 0 in 0.312s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2df45b4f-511c-4fa5-b24f-1823398a0f71 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-quobyte-f148a037-6f9e-4314-bcc7-b02d1a7e9f63" released by "delete_volume" :: held 0.796s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:38 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-2df45b4f-511c-4fa5-b24f-1823398a0f71 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Created reservations ['979b5420-b744-4a4c-b76f-d8cad6d90571', 'c52ef59d-0c2e-40b8-ad4c-317734c9c45e', '164cec6c-df2c-417d-ac77-ca45103b4e7d', '9bbc5c7e-49a6-4143-8546-d73bdc4832f2'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2df45b4f-511c-4fa5-b24f-1823398a0f71 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2df45b4f-511c-4fa5-b24f-1823398a0f71 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:38 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2df45b4f-511c-4fa5-b24f-1823398a0f71 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:38 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2df45b4f-511c-4fa5-b24f-1823398a0f71 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2df45b4f-511c-4fa5-b24f-1823398a0f71 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2df45b4f-511c-4fa5-b24f-1823398a0f71 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:38 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:41:38 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ae11bab4-89f4-4da6-a8b2-6b83b5b39ccc tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "cinder-c24126ce-78cf-4a44-b94c-3ae82fdb052b-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ae11bab4-89f4-4da6-a8b2-6b83b5b39ccc tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-c24126ce-78cf-4a44-b94c-3ae82fdb052b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:39 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ae11bab4-89f4-4da6-a8b2-6b83b5b39ccc tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "cinder-quobyte-c24126ce-78cf-4a44-b94c-3ae82fdb052b" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:39 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ae11bab4-89f4-4da6-a8b2-6b83b5b39ccc tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-quobyte-c24126ce-78cf-4a44-b94c-3ae82fdb052b" acquired by "delete_volume" :: waited 0.023s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:39 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c282811-2d66-4712-b83d-15cebfee5efe]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ae11bab4-89f4-4da6-a8b2-6b83b5b39ccc tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c24126ce-78cf-4a44-b94c-3ae82fdb052b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:39 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2df45b4f-511c-4fa5-b24f-1823398a0f71 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.339s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:39 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-2df45b4f-511c-4fa5-b24f-1823398a0f71 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:39 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-2df45b4f-511c-4fa5-b24f-1823398a0f71 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Deleted volume successfully. Nov 03 07:41:39 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2df45b4f-511c-4fa5-b24f-1823398a0f71 tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-f148a037-6f9e-4314-bcc7-b02d1a7e9f63-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:39 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c24126ce-78cf-4a44-b94c-3ae82fdb052b Nov 03 07:41:39 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:39 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ae11bab4-89f4-4da6-a8b2-6b83b5b39ccc tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c24126ce-78cf-4a44-b94c-3ae82fdb052b" returned: 0 in 0.423s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ae11bab4-89f4-4da6-a8b2-6b83b5b39ccc tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c24126ce-78cf-4a44-b94c-3ae82fdb052b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:39 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c24126ce-78cf-4a44-b94c-3ae82fdb052b Nov 03 07:41:39 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:39 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ae11bab4-89f4-4da6-a8b2-6b83b5b39ccc tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c24126ce-78cf-4a44-b94c-3ae82fdb052b" returned: 0 in 0.252s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:39 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ae11bab4-89f4-4da6-a8b2-6b83b5b39ccc tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-quobyte-c24126ce-78cf-4a44-b94c-3ae82fdb052b" released by "delete_volume" :: held 0.742s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:39 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-ae11bab4-89f4-4da6-a8b2-6b83b5b39ccc tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Created reservations ['16b3d38e-7413-4f43-bbf6-cceda84c11fb', '863c9f2f-9742-4b9e-913c-e79ab09e2ebe', '37f8485e-3dbd-4035-8bb0-52676fa05bd4', '811e8c1d-11d6-4c1c-ba04-a4ccc32818ae'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ae11bab4-89f4-4da6-a8b2-6b83b5b39ccc tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ae11bab4-89f4-4da6-a8b2-6b83b5b39ccc tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ae11bab4-89f4-4da6-a8b2-6b83b5b39ccc tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ae11bab4-89f4-4da6-a8b2-6b83b5b39ccc tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ae11bab4-89f4-4da6-a8b2-6b83b5b39ccc tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ae11bab4-89f4-4da6-a8b2-6b83b5b39ccc tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:39 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:41:39 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:40 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ae11bab4-89f4-4da6-a8b2-6b83b5b39ccc tempest-CreateVolumesFromSourceVolumeTest-870486634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.428s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:40 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-ae11bab4-89f4-4da6-a8b2-6b83b5b39ccc tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:40 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ae11bab4-89f4-4da6-a8b2-6b83b5b39ccc tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Deleted volume successfully. Nov 03 07:41:40 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ae11bab4-89f4-4da6-a8b2-6b83b5b39ccc tempest-CreateVolumesFromSourceVolumeTest-870486634 None] Lock "cinder-c24126ce-78cf-4a44-b94c-3ae82fdb052b-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:44 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Flow 'volume_create_manager' (70c9fc43-338d-48f0-bb86-df1bb149e5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7f33b8-60c6-43cd-a37e-fcf484c10d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7f33b8-60c6-43cd-a37e-fcf484c10d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-522555973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcacf426-b152-433b-b15f-e52942e7f08f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f4639ca3f844ae9cd2a5b05fd995c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:45Z,use_quota=True,user_id='8831a47ef54244d19a99203f4efff644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d980633-4bfa-467d-97aa-40ecb0a4d6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d980633-4bfa-467d-97aa-40ecb0a4d6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e146cc6-854e-43f4-ad8e-69bf35514bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e146cc6-854e-43f4-ad8e-69bf35514bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcacf426-b152-433b-b15f-e52942e7f08f', 'volume_name': 'volume-dcacf426-b152-433b-b15f-e52942e7f08f', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57a86a0-9b7d-4907-bd04-2f04ace2d829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57a86a0-9b7d-4907-bd04-2f04ace2d829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67104a78-894d-475c-9bf5-fe22ceed20ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:44 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Volume dcacf426-b152-433b-b15f-e52942e7f08f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcacf426-b152-433b-b15f-e52942e7f08f', 'volume_size': 1} Nov 03 07:41:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-522555973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcacf426-b152-433b-b15f-e52942e7f08f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f4639ca3f844ae9cd2a5b05fd995c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:45Z,use_quota=True,user_id='8831a47ef54244d19a99203f4efff644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:41:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Creating volume dcacf426-b152-433b-b15f-e52942e7f08f {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:44 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:41:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dcacf426-b152-433b-b15f-e52942e7f08f 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:44 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dcacf426-b152-433b-b15f-e52942e7f08f 1073741824 Nov 03 07:41:44 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:45 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dcacf426-b152-433b-b15f-e52942e7f08f 1073741824" returned: 0 in 0.562s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dcacf426-b152-433b-b15f-e52942e7f08f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:45 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dcacf426-b152-433b-b15f-e52942e7f08f Nov 03 07:41:45 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:45 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dcacf426-b152-433b-b15f-e52942e7f08f" returned: 0 in 0.293s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:45 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:41:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67104a78-894d-475c-9bf5-fe22ceed20ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcacf426-b152-433b-b15f-e52942e7f08f', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e4ec80-bba0-4463-8118-28758dfe4e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:45 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Volume volume-dcacf426-b152-433b-b15f-e52942e7f08f (dcacf426-b152-433b-b15f-e52942e7f08f): created successfully Nov 03 07:41:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e4ec80-bba0-4463-8118-28758dfe4e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Flow 'volume_create_manager' (70c9fc43-338d-48f0-bb86-df1bb149e5d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:45 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a3a39135-cdb7-4728-a37d-812252b222b5 tempest-ProjectReaderTests-1295043133 None] Created volume successfully. Nov 03 07:41:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4a8fe329-fb21-4a44-b1ad-008ae9f8c9ff tempest-ProjectReaderTests-1295043133 None] Acquiring lock "cinder-dcacf426-b152-433b-b15f-e52942e7f08f-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4a8fe329-fb21-4a44-b1ad-008ae9f8c9ff tempest-ProjectReaderTests-1295043133 None] Lock "cinder-dcacf426-b152-433b-b15f-e52942e7f08f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:47 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4a8fe329-fb21-4a44-b1ad-008ae9f8c9ff tempest-ProjectReaderTests-1295043133 None] Acquiring lock "cinder-quobyte-dcacf426-b152-433b-b15f-e52942e7f08f" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:47 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4a8fe329-fb21-4a44-b1ad-008ae9f8c9ff tempest-ProjectReaderTests-1295043133 None] Lock "cinder-quobyte-dcacf426-b152-433b-b15f-e52942e7f08f" acquired by "delete_volume" :: waited 0.018s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:47 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5ddfa5-9eb0-4035-8e5f-a2b146b940db]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4a8fe329-fb21-4a44-b1ad-008ae9f8c9ff tempest-ProjectReaderTests-1295043133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dcacf426-b152-433b-b15f-e52942e7f08f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:47 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dcacf426-b152-433b-b15f-e52942e7f08f Nov 03 07:41:47 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:47 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4a8fe329-fb21-4a44-b1ad-008ae9f8c9ff tempest-ProjectReaderTests-1295043133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dcacf426-b152-433b-b15f-e52942e7f08f" returned: 0 in 0.425s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4a8fe329-fb21-4a44-b1ad-008ae9f8c9ff tempest-ProjectReaderTests-1295043133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dcacf426-b152-433b-b15f-e52942e7f08f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:47 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dcacf426-b152-433b-b15f-e52942e7f08f Nov 03 07:41:47 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:47 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4a8fe329-fb21-4a44-b1ad-008ae9f8c9ff tempest-ProjectReaderTests-1295043133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dcacf426-b152-433b-b15f-e52942e7f08f" returned: 0 in 0.372s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:47 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4a8fe329-fb21-4a44-b1ad-008ae9f8c9ff tempest-ProjectReaderTests-1295043133 None] Lock "cinder-quobyte-dcacf426-b152-433b-b15f-e52942e7f08f" released by "delete_volume" :: held 0.856s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:47 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-4a8fe329-fb21-4a44-b1ad-008ae9f8c9ff tempest-ProjectReaderTests-1295043133 None] Created reservations ['d1ac4a83-421e-498b-9f0d-523f04f46352', 'd67a5bb5-2f20-4199-8557-0e3fcfed8014', 'f112628a-26b1-4571-8429-cb2daa51a79a', '3e1cd459-8a01-41ff-a354-d3e41c64c7f2'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4a8fe329-fb21-4a44-b1ad-008ae9f8c9ff tempest-ProjectReaderTests-1295043133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4a8fe329-fb21-4a44-b1ad-008ae9f8c9ff tempest-ProjectReaderTests-1295043133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4a8fe329-fb21-4a44-b1ad-008ae9f8c9ff tempest-ProjectReaderTests-1295043133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4a8fe329-fb21-4a44-b1ad-008ae9f8c9ff tempest-ProjectReaderTests-1295043133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4a8fe329-fb21-4a44-b1ad-008ae9f8c9ff tempest-ProjectReaderTests-1295043133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4a8fe329-fb21-4a44-b1ad-008ae9f8c9ff tempest-ProjectReaderTests-1295043133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:48 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:41:48 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:48 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4a8fe329-fb21-4a44-b1ad-008ae9f8c9ff tempest-ProjectReaderTests-1295043133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.413s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-4a8fe329-fb21-4a44-b1ad-008ae9f8c9ff tempest-ProjectReaderTests-1295043133 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:48 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-4a8fe329-fb21-4a44-b1ad-008ae9f8c9ff tempest-ProjectReaderTests-1295043133 None] Deleted volume successfully. Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-4a8fe329-fb21-4a44-b1ad-008ae9f8c9ff tempest-ProjectReaderTests-1295043133 None] Lock "cinder-dcacf426-b152-433b-b15f-e52942e7f08f-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Flow 'volume_create_manager' (fc9ee4af-199f-4f28-8125-5897fa3b418d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489b3c57-f464-4d6e-a221-b322f7ab7699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489b3c57-f464-4d6e-a221-b322f7ab7699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1336907087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6be77e85-c8d0-4a3d-b07d-a35843ce7616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f4639ca3f844ae9cd2a5b05fd995c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:49Z,use_quota=True,user_id='8831a47ef54244d19a99203f4efff644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a8ce85-65e3-4bc3-8f18-bd7d1ec1ebf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a8ce85-65e3-4bc3-8f18-bd7d1ec1ebf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f973b9a5-becb-4cbc-b54d-fb26de7bc269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f973b9a5-becb-4cbc-b54d-fb26de7bc269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6be77e85-c8d0-4a3d-b07d-a35843ce7616', 'volume_name': 'volume-6be77e85-c8d0-4a3d-b07d-a35843ce7616', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef0e896-8662-4922-819e-1caa41b425b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef0e896-8662-4922-819e-1caa41b425b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd75c15-22dd-4297-9c6e-70b8b4fbbd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:48 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Volume 6be77e85-c8d0-4a3d-b07d-a35843ce7616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6be77e85-c8d0-4a3d-b07d-a35843ce7616', 'volume_size': 1} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1336907087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6be77e85-c8d0-4a3d-b07d-a35843ce7616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f4639ca3f844ae9cd2a5b05fd995c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:49Z,use_quota=True,user_id='8831a47ef54244d19a99203f4efff644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Creating volume 6be77e85-c8d0-4a3d-b07d-a35843ce7616 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:48 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:41:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6be77e85-c8d0-4a3d-b07d-a35843ce7616 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:48 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6be77e85-c8d0-4a3d-b07d-a35843ce7616 1073741824 Nov 03 07:41:48 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:41:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:49 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:41:49 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:49 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6be77e85-c8d0-4a3d-b07d-a35843ce7616 1073741824" returned: 0 in 0.550s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:49 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6be77e85-c8d0-4a3d-b07d-a35843ce7616 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.370s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:41:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 28 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:41:49 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6be77e85-c8d0-4a3d-b07d-a35843ce7616 Nov 03 07:41:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:41:49 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:49 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6be77e85-c8d0-4a3d-b07d-a35843ce7616" returned: 0 in 0.315s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:41:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd75c15-22dd-4297-9c6e-70b8b4fbbd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6be77e85-c8d0-4a3d-b07d-a35843ce7616', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (facbb4dd-94a1-4c9a-93e0-e87496f1f266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:49 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Volume volume-6be77e85-c8d0-4a3d-b07d-a35843ce7616 (6be77e85-c8d0-4a3d-b07d-a35843ce7616): created successfully Nov 03 07:41:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (facbb4dd-94a1-4c9a-93e0-e87496f1f266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Flow 'volume_create_manager' (fc9ee4af-199f-4f28-8125-5897fa3b418d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:49 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a1c64985-454a-4bcd-ab6e-114e8dffde47 tempest-ProjectReaderTests-1295043133 None] Created volume successfully. Nov 03 07:41:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6829f2ea-9aea-47e0-996f-29c4e03a730e tempest-ProjectReaderTests-1295043133 None] Acquiring lock "cinder-6be77e85-c8d0-4a3d-b07d-a35843ce7616-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6829f2ea-9aea-47e0-996f-29c4e03a730e tempest-ProjectReaderTests-1295043133 None] Lock "cinder-6be77e85-c8d0-4a3d-b07d-a35843ce7616-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6829f2ea-9aea-47e0-996f-29c4e03a730e tempest-ProjectReaderTests-1295043133 None] Acquiring lock "cinder-quobyte-6be77e85-c8d0-4a3d-b07d-a35843ce7616" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6829f2ea-9aea-47e0-996f-29c4e03a730e tempest-ProjectReaderTests-1295043133 None] Lock "cinder-quobyte-6be77e85-c8d0-4a3d-b07d-a35843ce7616" acquired by "delete_volume" :: waited 0.021s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:51 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0f58c3-340d-4455-81aa-33d1337361c4]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6829f2ea-9aea-47e0-996f-29c4e03a730e tempest-ProjectReaderTests-1295043133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6be77e85-c8d0-4a3d-b07d-a35843ce7616 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:51 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6be77e85-c8d0-4a3d-b07d-a35843ce7616 Nov 03 07:41:51 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:51 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6829f2ea-9aea-47e0-996f-29c4e03a730e tempest-ProjectReaderTests-1295043133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6be77e85-c8d0-4a3d-b07d-a35843ce7616" returned: 0 in 0.411s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6829f2ea-9aea-47e0-996f-29c4e03a730e tempest-ProjectReaderTests-1295043133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6be77e85-c8d0-4a3d-b07d-a35843ce7616 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:51 devstack sudo[104140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6be77e85-c8d0-4a3d-b07d-a35843ce7616 Nov 03 07:41:51 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:51 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6829f2ea-9aea-47e0-996f-29c4e03a730e tempest-ProjectReaderTests-1295043133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6be77e85-c8d0-4a3d-b07d-a35843ce7616" returned: 0 in 0.299s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6829f2ea-9aea-47e0-996f-29c4e03a730e tempest-ProjectReaderTests-1295043133 None] Lock "cinder-quobyte-6be77e85-c8d0-4a3d-b07d-a35843ce7616" released by "delete_volume" :: held 0.779s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:51 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-6829f2ea-9aea-47e0-996f-29c4e03a730e tempest-ProjectReaderTests-1295043133 None] Created reservations ['a838494a-068d-4d04-93ba-716923aeeaf1', 'b237252c-255a-40ea-91ba-1dda7969a2f4', '12ec041c-2163-40b5-89ce-79e720d6cb5c', '21f28bb5-dc7b-41ad-b53d-36490cb2f19e'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Flow 'volume_create_manager' (73cda8cf-e92c-4fb8-af64-4983e38b4bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddbab031-7da6-439d-bc2b-793c7c6b6df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddbab031-7da6-439d-bc2b-793c7c6b6df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-988259880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7787618d-e362-4936-be22-9e73a5890d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc7ce2f5ca64d04a65d89c6ed75af6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:52Z,use_quota=True,user_id='a792d4991bb14209abaf1cebea6a5083',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85f5859-798a-436f-9994-13010b5b14c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85f5859-798a-436f-9994-13010b5b14c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (271d5e02-6a7c-4b7d-a5f9-0d560c4f5a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (271d5e02-6a7c-4b7d-a5f9-0d560c4f5a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7787618d-e362-4936-be22-9e73a5890d90', 'volume_name': 'volume-7787618d-e362-4936-be22-9e73a5890d90', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a1e8e45-ecae-4113-aee8-5544874bd720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a1e8e45-ecae-4113-aee8-5544874bd720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35fee711-dd76-493b-9261-2ef5f086c3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:52 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Volume 7787618d-e362-4936-be22-9e73a5890d90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7787618d-e362-4936-be22-9e73a5890d90', 'volume_size': 1} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-988259880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7787618d-e362-4936-be22-9e73a5890d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc7ce2f5ca64d04a65d89c6ed75af6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:52Z,use_quota=True,user_id='a792d4991bb14209abaf1cebea6a5083',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Creating volume 7787618d-e362-4936-be22-9e73a5890d90 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:52 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:52 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90 1073741824 Nov 03 07:41:52 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6829f2ea-9aea-47e0-996f-29c4e03a730e tempest-ProjectReaderTests-1295043133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6829f2ea-9aea-47e0-996f-29c4e03a730e tempest-ProjectReaderTests-1295043133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6829f2ea-9aea-47e0-996f-29c4e03a730e tempest-ProjectReaderTests-1295043133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6829f2ea-9aea-47e0-996f-29c4e03a730e tempest-ProjectReaderTests-1295043133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6829f2ea-9aea-47e0-996f-29c4e03a730e tempest-ProjectReaderTests-1295043133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6829f2ea-9aea-47e0-996f-29c4e03a730e tempest-ProjectReaderTests-1295043133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:52 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:41:52 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:52 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6829f2ea-9aea-47e0-996f-29c4e03a730e tempest-ProjectReaderTests-1295043133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.372s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-6829f2ea-9aea-47e0-996f-29c4e03a730e tempest-ProjectReaderTests-1295043133 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:52 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-6829f2ea-9aea-47e0-996f-29c4e03a730e tempest-ProjectReaderTests-1295043133 None] Deleted volume successfully. Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6829f2ea-9aea-47e0-996f-29c4e03a730e tempest-ProjectReaderTests-1295043133 None] Lock "cinder-6be77e85-c8d0-4a3d-b07d-a35843ce7616-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:52 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90 1073741824" returned: 0 in 0.647s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:52 devstack sudo[104152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90 Nov 03 07:41:52 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Flow 'volume_create_manager' (093cb274-60ce-4027-ada8-6e3b7782f541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a105d9a-4965-48a0-80a0-f7eb91847041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a105d9a-4965-48a0-80a0-f7eb91847041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1967262417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f252b7-3282-4423-ad23-75e0dbe49c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f4639ca3f844ae9cd2a5b05fd995c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:53Z,use_quota=True,user_id='8831a47ef54244d19a99203f4efff644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c190f12-7ff1-4572-befc-4d869c98cdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c190f12-7ff1-4572-befc-4d869c98cdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ba1f75-5693-4fbf-b5d9-2feb1cdb450a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ba1f75-5693-4fbf-b5d9-2feb1cdb450a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84f252b7-3282-4423-ad23-75e0dbe49c06', 'volume_name': 'volume-84f252b7-3282-4423-ad23-75e0dbe49c06', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52b5df76-eaaa-4005-8754-b9f2fa99c5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52b5df76-eaaa-4005-8754-b9f2fa99c5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d1d47f-d18d-4ca8-8d45-656034bc5bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:53 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Volume 84f252b7-3282-4423-ad23-75e0dbe49c06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84f252b7-3282-4423-ad23-75e0dbe49c06', 'volume_size': 1} Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:53 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90" returned: 0 in 0.292s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.139s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1967262417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f252b7-3282-4423-ad23-75e0dbe49c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f4639ca3f844ae9cd2a5b05fd995c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:53Z,use_quota=True,user_id='8831a47ef54244d19a99203f4efff644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Creating volume 84f252b7-3282-4423-ad23-75e0dbe49c06 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:53 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-84f252b7-3282-4423-ad23-75e0dbe49c06 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35fee711-dd76-493b-9261-2ef5f086c3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7787618d-e362-4936-be22-9e73a5890d90', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:53 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-84f252b7-3282-4423-ad23-75e0dbe49c06 1073741824 Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc11e638-0dfe-46ba-9eb4-6950d459dcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:53 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:53 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Volume volume-7787618d-e362-4936-be22-9e73a5890d90 (7787618d-e362-4936-be22-9e73a5890d90): created successfully Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc11e638-0dfe-46ba-9eb4-6950d459dcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Flow 'volume_create_manager' (73cda8cf-e92c-4fb8-af64-4983e38b4bb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:53 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-24db7af7-9ee2-4ec2-ad27-9382d54a2039 tempest-TestStampPattern-1301464608 None] Created volume successfully. Nov 03 07:41:53 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-84f252b7-3282-4423-ad23-75e0dbe49c06 1073741824" returned: 0 in 0.528s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-84f252b7-3282-4423-ad23-75e0dbe49c06 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:53 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-84f252b7-3282-4423-ad23-75e0dbe49c06 Nov 03 07:41:53 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:54 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-84f252b7-3282-4423-ad23-75e0dbe49c06" returned: 0 in 0.302s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:41:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:54 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d1d47f-d18d-4ca8-8d45-656034bc5bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84f252b7-3282-4423-ad23-75e0dbe49c06', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:54 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597dcb93-58d8-4ca1-b69e-fc6bf7920d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:54 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Volume volume-84f252b7-3282-4423-ad23-75e0dbe49c06 (84f252b7-3282-4423-ad23-75e0dbe49c06): created successfully Nov 03 07:41:54 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597dcb93-58d8-4ca1-b69e-fc6bf7920d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:54 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Flow 'volume_create_manager' (093cb274-60ce-4027-ada8-6e3b7782f541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:54 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ea6b0233-d0a0-45b7-9558-cb210df35f80 tempest-ProjectReaderTests-1295043133 None] Created volume successfully. Nov 03 07:41:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5946177d-2dd3-4110-81ee-32187a185bae tempest-ProjectReaderTests-1295043133 None] Acquiring lock "cinder-84f252b7-3282-4423-ad23-75e0dbe49c06-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5946177d-2dd3-4110-81ee-32187a185bae tempest-ProjectReaderTests-1295043133 None] Lock "cinder-84f252b7-3282-4423-ad23-75e0dbe49c06-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5946177d-2dd3-4110-81ee-32187a185bae tempest-ProjectReaderTests-1295043133 None] Acquiring lock "cinder-quobyte-84f252b7-3282-4423-ad23-75e0dbe49c06" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5946177d-2dd3-4110-81ee-32187a185bae tempest-ProjectReaderTests-1295043133 None] Lock "cinder-quobyte-84f252b7-3282-4423-ad23-75e0dbe49c06" acquired by "delete_volume" :: waited 0.018s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:55 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7985cb4-46d7-4df7-b6c7-3c46ba8cdcf0]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5946177d-2dd3-4110-81ee-32187a185bae tempest-ProjectReaderTests-1295043133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-84f252b7-3282-4423-ad23-75e0dbe49c06 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:55 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-84f252b7-3282-4423-ad23-75e0dbe49c06 Nov 03 07:41:55 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:55 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5946177d-2dd3-4110-81ee-32187a185bae tempest-ProjectReaderTests-1295043133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-84f252b7-3282-4423-ad23-75e0dbe49c06" returned: 0 in 0.507s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5946177d-2dd3-4110-81ee-32187a185bae tempest-ProjectReaderTests-1295043133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-84f252b7-3282-4423-ad23-75e0dbe49c06 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:55 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-84f252b7-3282-4423-ad23-75e0dbe49c06 Nov 03 07:41:55 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:56 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5946177d-2dd3-4110-81ee-32187a185bae tempest-ProjectReaderTests-1295043133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-84f252b7-3282-4423-ad23-75e0dbe49c06" returned: 0 in 0.289s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:56 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5946177d-2dd3-4110-81ee-32187a185bae tempest-ProjectReaderTests-1295043133 None] Lock "cinder-quobyte-84f252b7-3282-4423-ad23-75e0dbe49c06" released by "delete_volume" :: held 0.854s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:56 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-5946177d-2dd3-4110-81ee-32187a185bae tempest-ProjectReaderTests-1295043133 None] Created reservations ['42e44a40-e10f-4c30-8e82-7635efdf927e', '9742aaeb-e52e-447d-ae21-c924c5a8f841', '34b880d7-ea7b-4528-a393-a22b93a6fb03', '37d18a4d-cb5b-4386-b9fc-5cb26586d96f'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5946177d-2dd3-4110-81ee-32187a185bae tempest-ProjectReaderTests-1295043133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5946177d-2dd3-4110-81ee-32187a185bae tempest-ProjectReaderTests-1295043133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5946177d-2dd3-4110-81ee-32187a185bae tempest-ProjectReaderTests-1295043133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5946177d-2dd3-4110-81ee-32187a185bae tempest-ProjectReaderTests-1295043133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5946177d-2dd3-4110-81ee-32187a185bae tempest-ProjectReaderTests-1295043133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5946177d-2dd3-4110-81ee-32187a185bae tempest-ProjectReaderTests-1295043133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:56 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:41:56 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:56 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5946177d-2dd3-4110-81ee-32187a185bae tempest-ProjectReaderTests-1295043133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.387s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:56 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-5946177d-2dd3-4110-81ee-32187a185bae tempest-ProjectReaderTests-1295043133 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:56 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-5946177d-2dd3-4110-81ee-32187a185bae tempest-ProjectReaderTests-1295043133 None] Deleted volume successfully. Nov 03 07:41:56 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-5946177d-2dd3-4110-81ee-32187a185bae tempest-ProjectReaderTests-1295043133 None] Lock "cinder-84f252b7-3282-4423-ad23-75e0dbe49c06-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:56 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:UPDATE=142,cinder:SELECT=102,cinder:INSERT=31,cinder:DELETE=13 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:41:56 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Flow 'volume_create_manager' (e7d5ceb1-f133-49db-8e94-8c00fa8ac82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4dd136-b097-40cf-9e47-e85af35d7581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4dd136-b097-40cf-9e47-e85af35d7581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1699393799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89e3400-ce5e-4f63-bc0b-beba3f1e0104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f4639ca3f844ae9cd2a5b05fd995c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:57Z,use_quota=True,user_id='8831a47ef54244d19a99203f4efff644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (752e3728-94ad-4ab6-8f67-13dc0b54d031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (752e3728-94ad-4ab6-8f67-13dc0b54d031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1fb6a1c-02e5-4c96-8e36-51e191168b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1fb6a1c-02e5-4c96-8e36-51e191168b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e89e3400-ce5e-4f63-bc0b-beba3f1e0104', 'volume_name': 'volume-e89e3400-ce5e-4f63-bc0b-beba3f1e0104', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3997ab9-8eea-4c78-918e-12797a579e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3997ab9-8eea-4c78-918e-12797a579e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00d455c-fb03-432b-810c-fd8a4689c8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:57 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Volume e89e3400-ce5e-4f63-bc0b-beba3f1e0104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e89e3400-ce5e-4f63-bc0b-beba3f1e0104', 'volume_size': 1} Nov 03 07:41:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:57 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1699393799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89e3400-ce5e-4f63-bc0b-beba3f1e0104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f4639ca3f844ae9cd2a5b05fd995c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:57Z,use_quota=True,user_id='8831a47ef54244d19a99203f4efff644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:41:57 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Creating volume e89e3400-ce5e-4f63-bc0b-beba3f1e0104 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:57 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:57 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:57 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:57 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:41:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e89e3400-ce5e-4f63-bc0b-beba3f1e0104 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:57 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e89e3400-ce5e-4f63-bc0b-beba3f1e0104 1073741824 Nov 03 07:41:57 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:57 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e89e3400-ce5e-4f63-bc0b-beba3f1e0104 1073741824" returned: 0 in 0.585s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e89e3400-ce5e-4f63-bc0b-beba3f1e0104 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:57 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e89e3400-ce5e-4f63-bc0b-beba3f1e0104 Nov 03 07:41:57 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:58 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e89e3400-ce5e-4f63-bc0b-beba3f1e0104" returned: 0 in 0.649s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:41:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00d455c-fb03-432b-810c-fd8a4689c8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e89e3400-ce5e-4f63-bc0b-beba3f1e0104', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (828b7228-5bc4-4944-80c4-98887ceea10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:58 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Volume volume-e89e3400-ce5e-4f63-bc0b-beba3f1e0104 (e89e3400-ce5e-4f63-bc0b-beba3f1e0104): created successfully Nov 03 07:41:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (828b7228-5bc4-4944-80c4-98887ceea10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Flow 'volume_create_manager' (e7d5ceb1-f133-49db-8e94-8c00fa8ac82a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:58 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-276cd712-4953-4627-b93d-fcc362f8aa41 tempest-ProjectReaderTests-1295043133 None] Created volume successfully. Nov 03 07:41:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1e7627a9-a26d-4874-8ff3-c54ec3095392 tempest-ProjectReaderTests-1295043133 None] Acquiring lock "cinder-e89e3400-ce5e-4f63-bc0b-beba3f1e0104-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1e7627a9-a26d-4874-8ff3-c54ec3095392 tempest-ProjectReaderTests-1295043133 None] Lock "cinder-e89e3400-ce5e-4f63-bc0b-beba3f1e0104-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1e7627a9-a26d-4874-8ff3-c54ec3095392 tempest-ProjectReaderTests-1295043133 None] Acquiring lock "cinder-quobyte-e89e3400-ce5e-4f63-bc0b-beba3f1e0104" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1e7627a9-a26d-4874-8ff3-c54ec3095392 tempest-ProjectReaderTests-1295043133 None] Lock "cinder-quobyte-e89e3400-ce5e-4f63-bc0b-beba3f1e0104" acquired by "delete_volume" :: waited 0.024s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:59 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ce1403-9881-406f-8c55-227e58b63f89]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1e7627a9-a26d-4874-8ff3-c54ec3095392 tempest-ProjectReaderTests-1295043133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e89e3400-ce5e-4f63-bc0b-beba3f1e0104 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:59 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e89e3400-ce5e-4f63-bc0b-beba3f1e0104 Nov 03 07:41:59 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:59 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1e7627a9-a26d-4874-8ff3-c54ec3095392 tempest-ProjectReaderTests-1295043133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e89e3400-ce5e-4f63-bc0b-beba3f1e0104" returned: 0 in 0.504s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1e7627a9-a26d-4874-8ff3-c54ec3095392 tempest-ProjectReaderTests-1295043133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e89e3400-ce5e-4f63-bc0b-beba3f1e0104 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:59 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e89e3400-ce5e-4f63-bc0b-beba3f1e0104 Nov 03 07:41:59 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:00 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1e7627a9-a26d-4874-8ff3-c54ec3095392 tempest-ProjectReaderTests-1295043133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e89e3400-ce5e-4f63-bc0b-beba3f1e0104" returned: 0 in 0.283s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1e7627a9-a26d-4874-8ff3-c54ec3095392 tempest-ProjectReaderTests-1295043133 None] Lock "cinder-quobyte-e89e3400-ce5e-4f63-bc0b-beba3f1e0104" released by "delete_volume" :: held 0.849s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:00 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-1e7627a9-a26d-4874-8ff3-c54ec3095392 tempest-ProjectReaderTests-1295043133 None] Created reservations ['3ebed969-4baa-40c2-9398-7648a65eb5cc', 'b2905fd6-adc1-44b2-94af-5eacc92760c7', '4aa3ecc8-6f8a-4780-95c1-db1e12a3931b', '6bc6d75f-e9c8-42fd-b52d-c23063ecf68f'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1e7627a9-a26d-4874-8ff3-c54ec3095392 tempest-ProjectReaderTests-1295043133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1e7627a9-a26d-4874-8ff3-c54ec3095392 tempest-ProjectReaderTests-1295043133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1e7627a9-a26d-4874-8ff3-c54ec3095392 tempest-ProjectReaderTests-1295043133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1e7627a9-a26d-4874-8ff3-c54ec3095392 tempest-ProjectReaderTests-1295043133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1e7627a9-a26d-4874-8ff3-c54ec3095392 tempest-ProjectReaderTests-1295043133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1e7627a9-a26d-4874-8ff3-c54ec3095392 tempest-ProjectReaderTests-1295043133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:00 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:42:00 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:00 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1e7627a9-a26d-4874-8ff3-c54ec3095392 tempest-ProjectReaderTests-1295043133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.425s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:00 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-1e7627a9-a26d-4874-8ff3-c54ec3095392 tempest-ProjectReaderTests-1295043133 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:00 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-1e7627a9-a26d-4874-8ff3-c54ec3095392 tempest-ProjectReaderTests-1295043133 None] Deleted volume successfully. Nov 03 07:42:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1e7627a9-a26d-4874-8ff3-c54ec3095392 tempest-ProjectReaderTests-1295043133 None] Lock "cinder-e89e3400-ce5e-4f63-bc0b-beba3f1e0104-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:10 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1,cinder:SELECT=7 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:42:10 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=87,cinder:INSERT=34,cinder:UPDATE=145,cinder:DELETE=12 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:42:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-336c76ca-0e22-44f0-810a-55132463aed1 req-6dd00afb-b504-4e9b-8cc7-a1797e727989 tempest-TestStampPattern-1301464608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-336c76ca-0e22-44f0-810a-55132463aed1 req-6dd00afb-b504-4e9b-8cc7-a1797e727989 tempest-TestStampPattern-1301464608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-336c76ca-0e22-44f0-810a-55132463aed1 req-6dd00afb-b504-4e9b-8cc7-a1797e727989 tempest-TestStampPattern-1301464608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-336c76ca-0e22-44f0-810a-55132463aed1 req-6dd00afb-b504-4e9b-8cc7-a1797e727989 tempest-TestStampPattern-1301464608 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14', 'name': 'volume-7787618d-e362-4936-be22-9e73a5890d90', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3dda6424-5ee1-4d1e-84b0-3eccd57ff35c', 'enforce_multipath': True} {{(pid=87016) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:42:25 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-336c76ca-0e22-44f0-810a-55132463aed1 req-6dd00afb-b504-4e9b-8cc7-a1797e727989 tempest-TestStampPattern-1301464608 None] attachment_update completed successfully. Nov 03 07:42:27 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Flow 'volume_create_manager' (37fb049d-b5b0-4471-91e2-07b681d4e016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a58921f-b303-4849-99aa-5e31c4ec2083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a58921f-b303-4849-99aa-5e31c4ec2083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1040620799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb8a2105eac4b858d366d36bb8fa45a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:27Z,use_quota=True,user_id='84212aa852fa43e3b6748a5312f73d20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74bb9af-8a64-4251-947c-e320bee834b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74bb9af-8a64-4251-947c-e320bee834b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f232b8e7-1368-4c90-b090-1e867b1abf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f232b8e7-1368-4c90-b090-1e867b1abf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce', 'volume_name': 'volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10423132-52da-4b71-bbcb-dc015f867363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10423132-52da-4b71-bbcb-dc015f867363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88823b9b-746c-4b82-90e3-d46f4d45b372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:27 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Volume 52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce', 'volume_size': 1} Nov 03 07:42:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1040620799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb8a2105eac4b858d366d36bb8fa45a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:27Z,use_quota=True,user_id='84212aa852fa43e3b6748a5312f73d20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:42:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Creating volume 52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:42:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:27 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:42:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:27 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce 1073741824 Nov 03 07:42:27 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:28 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce 1073741824" returned: 0 in 0.552s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:28 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce Nov 03 07:42:28 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:28 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce" returned: 0 in 0.355s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:42:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88823b9b-746c-4b82-90e3-d46f4d45b372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed9bcd8-c443-4375-8c01-694462f7ddcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:28 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Volume volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce (52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce): created successfully Nov 03 07:42:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed9bcd8-c443-4375-8c01-694462f7ddcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Flow 'volume_create_manager' (37fb049d-b5b0-4471-91e2-07b681d4e016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:28 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-65cfb65a-d1a4-4048-82e3-dfb3935a4516 tempest-SnapshotDependencyTests-1230379811 None] Created volume successfully. Nov 03 07:42:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2fe4ed29-8a1c-4479-923e-fe8b9eeb2b57 tempest-SnapshotDependencyTests-1230379811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2fe4ed29-8a1c-4479-923e-fe8b9eeb2b57 tempest-SnapshotDependencyTests-1230379811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-2fe4ed29-8a1c-4479-923e-fe8b9eeb2b57 tempest-SnapshotDependencyTests-1230379811 None] Creating offline snapshot bf5e1f01-0619-44fb-8d51-2db1c5e3610c of volume 52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:42:29 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b2fdd8-e4f1-4dee-856a-51cd4b0e1f9a]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2fe4ed29-8a1c-4479-923e-fe8b9eeb2b57 tempest-SnapshotDependencyTests-1230379811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:30 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce Nov 03 07:42:30 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:30 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2fe4ed29-8a1c-4479-923e-fe8b9eeb2b57 tempest-SnapshotDependencyTests-1230379811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce" returned: 0 in 0.438s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2fe4ed29-8a1c-4479-923e-fe8b9eeb2b57 tempest-SnapshotDependencyTests-1230379811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.bf5e1f01-0619-44fb-8d51-2db1c5e3610c 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:30 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.bf5e1f01-0619-44fb-8d51-2db1c5e3610c 1G Nov 03 07:42:30 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:30 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2fe4ed29-8a1c-4479-923e-fe8b9eeb2b57 tempest-SnapshotDependencyTests-1230379811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.bf5e1f01-0619-44fb-8d51-2db1c5e3610c 1G" returned: 0 in 0.580s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2fe4ed29-8a1c-4479-923e-fe8b9eeb2b57 tempest-SnapshotDependencyTests-1230379811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.bf5e1f01-0619-44fb-8d51-2db1c5e3610c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:30 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.bf5e1f01-0619-44fb-8d51-2db1c5e3610c Nov 03 07:42:30 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:31 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2fe4ed29-8a1c-4479-923e-fe8b9eeb2b57 tempest-SnapshotDependencyTests-1230379811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.bf5e1f01-0619-44fb-8d51-2db1c5e3610c" returned: 0 in 0.364s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:31 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-2fe4ed29-8a1c-4479-923e-fe8b9eeb2b57 tempest-SnapshotDependencyTests-1230379811 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.bf5e1f01-0619-44fb-8d51-2db1c5e3610c is being set with open permissions: ugo+rw Nov 03 07:42:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2fe4ed29-8a1c-4479-923e-fe8b9eeb2b57 tempest-SnapshotDependencyTests-1230379811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.bf5e1f01-0619-44fb-8d51-2db1c5e3610c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:31 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.bf5e1f01-0619-44fb-8d51-2db1c5e3610c Nov 03 07:42:31 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:31 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2fe4ed29-8a1c-4479-923e-fe8b9eeb2b57 tempest-SnapshotDependencyTests-1230379811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.bf5e1f01-0619-44fb-8d51-2db1c5e3610c" returned: 0 in 0.266s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2fe4ed29-8a1c-4479-923e-fe8b9eeb2b57 tempest-SnapshotDependencyTests-1230379811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:31 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.info Nov 03 07:42:31 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:31 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-860ee2b7-d529-44f3-9a46-f6dec61c0f13 req-79aea25e-816f-4035-829d-b210fbd3f0b1 tempest-TestStampPattern-1301464608 None] Terminate volume connection completed successfully. Nov 03 07:42:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-860ee2b7-d529-44f3-9a46-f6dec61c0f13 req-79aea25e-816f-4035-829d-b210fbd3f0b1 tempest-TestStampPattern-1301464608 None] Deleting attachment 3dda6424-5ee1-4d1e-84b0-3eccd57ff35c. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:42:31 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2fe4ed29-8a1c-4479-923e-fe8b9eeb2b57 tempest-SnapshotDependencyTests-1230379811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.info" returned: 0 in 0.341s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:31 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-2fe4ed29-8a1c-4479-923e-fe8b9eeb2b57 tempest-SnapshotDependencyTests-1230379811 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.info is being set with open permissions: ugo+rw Nov 03 07:42:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2fe4ed29-8a1c-4479-923e-fe8b9eeb2b57 tempest-SnapshotDependencyTests-1230379811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:31 devstack sudo[104877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.info Nov 03 07:42:31 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:32 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2fe4ed29-8a1c-4479-923e-fe8b9eeb2b57 tempest-SnapshotDependencyTests-1230379811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.info" returned: 0 in 0.253s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2fe4ed29-8a1c-4479-923e-fe8b9eeb2b57 tempest-SnapshotDependencyTests-1230379811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.358s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:32 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-2fe4ed29-8a1c-4479-923e-fe8b9eeb2b57 tempest-SnapshotDependencyTests-1230379811 None] Create snapshot completed successfully Nov 03 07:42:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f671fef9-0a98-444a-b5e4-bcaae8e7b2a0 tempest-TestStampPattern-1301464608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f671fef9-0a98-444a-b5e4-bcaae8e7b2a0 tempest-TestStampPattern-1301464608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:32 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-f671fef9-0a98-444a-b5e4-bcaae8e7b2a0 tempest-TestStampPattern-1301464608 None] Creating offline snapshot ef55c004-94c2-4700-9c63-97b29ee55b49 of volume 7787618d-e362-4936-be22-9e73a5890d90 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:42:32 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[86531615-785b-4237-b941-c4bad56c9232]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f671fef9-0a98-444a-b5e4-bcaae8e7b2a0 tempest-TestStampPattern-1301464608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:32 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90 Nov 03 07:42:32 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:33 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f671fef9-0a98-444a-b5e4-bcaae8e7b2a0 tempest-TestStampPattern-1301464608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90" returned: 0 in 0.457s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f671fef9-0a98-444a-b5e4-bcaae8e7b2a0 tempest-TestStampPattern-1301464608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.ef55c004-94c2-4700-9c63-97b29ee55b49 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:33 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.ef55c004-94c2-4700-9c63-97b29ee55b49 1G Nov 03 07:42:33 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:33 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f671fef9-0a98-444a-b5e4-bcaae8e7b2a0 tempest-TestStampPattern-1301464608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.ef55c004-94c2-4700-9c63-97b29ee55b49 1G" returned: 0 in 0.515s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f671fef9-0a98-444a-b5e4-bcaae8e7b2a0 tempest-TestStampPattern-1301464608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7787618d-e362-4936-be22-9e73a5890d90 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.ef55c004-94c2-4700-9c63-97b29ee55b49 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:33 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7787618d-e362-4936-be22-9e73a5890d90 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.ef55c004-94c2-4700-9c63-97b29ee55b49 Nov 03 07:42:33 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:33 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Flow 'volume_create_manager' (dd37e339-86f3-46eb-b421-5d1957648465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280c7706-9872-44fa-b891-df1548323471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280c7706-9872-44fa-b891-df1548323471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bc285b8-38e8-48f0-a7c9-891269ec3722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb8a2105eac4b858d366d36bb8fa45a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bf5e1f01-0619-44fb-8d51-2db1c5e3610c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:34Z,use_quota=True,user_id='84212aa852fa43e3b6748a5312f73d20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163a4e05-1f80-4ad4-a9eb-c0c5ad7ac059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163a4e05-1f80-4ad4-a9eb-c0c5ad7ac059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3169fc8a-38db-4f27-9601-a3453f8628bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3169fc8a-38db-4f27-9601-a3453f8628bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6bc285b8-38e8-48f0-a7c9-891269ec3722', 'volume_name': 'volume-6bc285b8-38e8-48f0-a7c9-891269ec3722', 'volume_size': 1, 'snapshot_id': 'bf5e1f01-0619-44fb-8d51-2db1c5e3610c'}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881f7372-ca77-4fde-8a1f-102bd1e46c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881f7372-ca77-4fde-8a1f-102bd1e46c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d951732-0620-40b2-89a5-1ebbb4e20808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:33 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Volume 6bc285b8-38e8-48f0-a7c9-891269ec3722: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6bc285b8-38e8-48f0-a7c9-891269ec3722', 'volume_size': 1, 'snapshot_id': 'bf5e1f01-0619-44fb-8d51-2db1c5e3610c'} Nov 03 07:42:33 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f671fef9-0a98-444a-b5e4-bcaae8e7b2a0 tempest-TestStampPattern-1301464608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7787618d-e362-4936-be22-9e73a5890d90 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.ef55c004-94c2-4700-9c63-97b29ee55b49" returned: 0 in 0.320s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:33 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-f671fef9-0a98-444a-b5e4-bcaae8e7b2a0 tempest-TestStampPattern-1301464608 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.ef55c004-94c2-4700-9c63-97b29ee55b49 is being set with open permissions: ugo+rw Nov 03 07:42:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f671fef9-0a98-444a-b5e4-bcaae8e7b2a0 tempest-TestStampPattern-1301464608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.ef55c004-94c2-4700-9c63-97b29ee55b49 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:33 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.ef55c004-94c2-4700-9c63-97b29ee55b49 Nov 03 07:42:33 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:34 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f671fef9-0a98-444a-b5e4-bcaae8e7b2a0 tempest-TestStampPattern-1301464608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.ef55c004-94c2-4700-9c63-97b29ee55b49" returned: 0 in 0.265s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f671fef9-0a98-444a-b5e4-bcaae8e7b2a0 tempest-TestStampPattern-1301464608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:34 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.info Nov 03 07:42:34 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:34 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f671fef9-0a98-444a-b5e4-bcaae8e7b2a0 tempest-TestStampPattern-1301464608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.info" returned: 0 in 0.253s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:34 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-f671fef9-0a98-444a-b5e4-bcaae8e7b2a0 tempest-TestStampPattern-1301464608 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.info is being set with open permissions: ugo+rw Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f671fef9-0a98-444a-b5e4-bcaae8e7b2a0 tempest-TestStampPattern-1301464608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:34 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.info Nov 03 07:42:34 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:34 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f671fef9-0a98-444a-b5e4-bcaae8e7b2a0 tempest-TestStampPattern-1301464608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.info" returned: 0 in 0.261s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f671fef9-0a98-444a-b5e4-bcaae8e7b2a0 tempest-TestStampPattern-1301464608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.167s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.840s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Acquiring lock "cinder-quobyte-bf5e1f01-0619-44fb-8d51-2db1c5e3610c-6bc285b8-38e8-48f0-a7c9-891269ec3722" by "_create_volume_from_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Lock "cinder-quobyte-bf5e1f01-0619-44fb-8d51-2db1c5e3610c-6bc285b8-38e8-48f0-a7c9-891269ec3722" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Creating volume 6bc285b8-38e8-48f0-a7c9-891269ec3722 from snapshot bf5e1f01-0619-44fb-8d51-2db1c5e3610c {{(pid=87016) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Acquiring lock "cinder-quobyte-6bc285b8-38e8-48f0-a7c9-891269ec3722" by "_copy_volume_from_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:34 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-f671fef9-0a98-444a-b5e4-bcaae8e7b2a0 tempest-TestStampPattern-1301464608 None] Create snapshot completed successfully Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Lock "cinder-quobyte-6bc285b8-38e8-48f0-a7c9-891269ec3722" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] snapshot: bf5e1f01-0619-44fb-8d51-2db1c5e3610c, volume: 6bc285b8-38e8-48f0-a7c9-891269ec3722, {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd601f4-ef09-47f0-a88a-3769712dee1f]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.bf5e1f01-0619-44fb-8d51-2db1c5e3610c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:35 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.bf5e1f01-0619-44fb-8d51-2db1c5e3610c Nov 03 07:42:35 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:35 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.bf5e1f01-0619-44fb-8d51-2db1c5e3610c" returned: 0 in 0.355s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:42:35 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac1e43d-6f52-470c-b8ae-6c02bef87129]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:35 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce Nov 03 07:42:35 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:35 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce" returned: 0 in 0.388s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:42:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Creating direct copy from snapshot {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:42:35 devstack cinder-volume[87016]: DEBUG cinder.utils [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Path /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6bc285b8-38e8-48f0-a7c9-891269ec3722 not found in is_blk_device check {{(pid=87016) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 07:42:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6bc285b8-38e8-48f0-a7c9-891269ec3722 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:35 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6bc285b8-38e8-48f0-a7c9-891269ec3722 Nov 03 07:42:35 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:43 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6bc285b8-38e8-48f0-a7c9-891269ec3722" returned: 0 in 7.461s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:43 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Image conversion details: src /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce, size 1024.00 MB, duration 7.46 sec, destination /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6bc285b8-38e8-48f0-a7c9-891269ec3722 {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:42:43 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Converted 1024.00 MB image at 137.22 MB/s Nov 03 07:42:43 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6bc285b8-38e8-48f0-a7c9-891269ec3722 is being set with open permissions: ugo+rw Nov 03 07:42:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6bc285b8-38e8-48f0-a7c9-891269ec3722 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:43 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6bc285b8-38e8-48f0-a7c9-891269ec3722 Nov 03 07:42:43 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:43 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6bc285b8-38e8-48f0-a7c9-891269ec3722" returned: 0 in 0.308s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Lock "cinder-quobyte-6bc285b8-38e8-48f0-a7c9-891269ec3722" released by "_copy_volume_from_snapshot" :: held 8.599s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Lock "cinder-quobyte-bf5e1f01-0619-44fb-8d51-2db1c5e3610c-6bc285b8-38e8-48f0-a7c9-891269ec3722" released by "_create_volume_from_snapshot" :: held 8.683s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.715s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d951732-0620-40b2-89a5-1ebbb4e20808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bc285b8-38e8-48f0-a7c9-891269ec3722', 'volume_size': 1, 'snapshot_id': 'bf5e1f01-0619-44fb-8d51-2db1c5e3610c'}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245e349a-c26f-410f-ad71-ed4b4cf29f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:43 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Volume volume-6bc285b8-38e8-48f0-a7c9-891269ec3722 (6bc285b8-38e8-48f0-a7c9-891269ec3722): created successfully Nov 03 07:42:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245e349a-c26f-410f-ad71-ed4b4cf29f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Flow 'volume_create_manager' (dd37e339-86f3-46eb-b421-5d1957648465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:43 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-50f17481-f652-4c81-8dcb-b295cb733baa tempest-SnapshotDependencyTests-1230379811 None] Created volume successfully. Nov 03 07:42:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ae46f43c-b0dd-441c-b280-687b9822808e tempest-SnapshotDependencyTests-1230379811 None] Acquiring lock "cinder-bf5e1f01-0619-44fb-8d51-2db1c5e3610c-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ae46f43c-b0dd-441c-b280-687b9822808e tempest-SnapshotDependencyTests-1230379811 None] Lock "cinder-bf5e1f01-0619-44fb-8d51-2db1c5e3610c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ae46f43c-b0dd-441c-b280-687b9822808e tempest-SnapshotDependencyTests-1230379811 None] Acquiring lock "cinder-quobyte-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ae46f43c-b0dd-441c-b280-687b9822808e tempest-SnapshotDependencyTests-1230379811 None] Lock "cinder-quobyte-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ae46f43c-b0dd-441c-b280-687b9822808e tempest-SnapshotDependencyTests-1230379811 None] Acquiring lock "cinder-quobyte-bf5e1f01-0619-44fb-8d51-2db1c5e3610c" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ae46f43c-b0dd-441c-b280-687b9822808e tempest-SnapshotDependencyTests-1230379811 None] Lock "cinder-quobyte-bf5e1f01-0619-44fb-8d51-2db1c5e3610c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-ae46f43c-b0dd-441c-b280-687b9822808e tempest-SnapshotDependencyTests-1230379811 None] Deleting offline snapshot bf5e1f01-0619-44fb-8d51-2db1c5e3610c of volume 52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:42:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-ae46f43c-b0dd-441c-b280-687b9822808e tempest-SnapshotDependencyTests-1230379811 None] snapshot_file for this snap is: volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.bf5e1f01-0619-44fb-8d51-2db1c5e3610c {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:42:44 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e3a34f-fc8f-4cf5-8b47-04d759eded7e]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ae46f43c-b0dd-441c-b280-687b9822808e tempest-SnapshotDependencyTests-1230379811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.bf5e1f01-0619-44fb-8d51-2db1c5e3610c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:44 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.bf5e1f01-0619-44fb-8d51-2db1c5e3610c Nov 03 07:42:44 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:44 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ae46f43c-b0dd-441c-b280-687b9822808e tempest-SnapshotDependencyTests-1230379811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.bf5e1f01-0619-44fb-8d51-2db1c5e3610c" returned: 0 in 0.358s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-ae46f43c-b0dd-441c-b280-687b9822808e tempest-SnapshotDependencyTests-1230379811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:42:44 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9ef473-ab44-444b-9f8a-b7cefe12dc6e]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ae46f43c-b0dd-441c-b280-687b9822808e tempest-SnapshotDependencyTests-1230379811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:45 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce Nov 03 07:42:45 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:45 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ae46f43c-b0dd-441c-b280-687b9822808e tempest-SnapshotDependencyTests-1230379811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce" returned: 0 in 0.528s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ae46f43c-b0dd-441c-b280-687b9822808e tempest-SnapshotDependencyTests-1230379811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.bf5e1f01-0619-44fb-8d51-2db1c5e3610c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:45 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.bf5e1f01-0619-44fb-8d51-2db1c5e3610c Nov 03 07:42:45 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:45 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ae46f43c-b0dd-441c-b280-687b9822808e tempest-SnapshotDependencyTests-1230379811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.bf5e1f01-0619-44fb-8d51-2db1c5e3610c" returned: 0 in 0.324s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ae46f43c-b0dd-441c-b280-687b9822808e tempest-SnapshotDependencyTests-1230379811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.bf5e1f01-0619-44fb-8d51-2db1c5e3610c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:45 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.bf5e1f01-0619-44fb-8d51-2db1c5e3610c Nov 03 07:42:45 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:46 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ae46f43c-b0dd-441c-b280-687b9822808e tempest-SnapshotDependencyTests-1230379811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce.bf5e1f01-0619-44fb-8d51-2db1c5e3610c" returned: 0 in 0.266s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ae46f43c-b0dd-441c-b280-687b9822808e tempest-SnapshotDependencyTests-1230379811 None] Lock "cinder-quobyte-bf5e1f01-0619-44fb-8d51-2db1c5e3610c" released by "_delete_snapshot" :: held 1.594s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ae46f43c-b0dd-441c-b280-687b9822808e tempest-SnapshotDependencyTests-1230379811 None] Lock "cinder-quobyte-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce" released by "delete_snapshot" :: held 1.619s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:47 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-ae46f43c-b0dd-441c-b280-687b9822808e tempest-SnapshotDependencyTests-1230379811 None] Created reservations ['3d395e79-2dc7-4e60-a3bd-bc29a07f045d', '6ebe3d79-ac57-4195-b8ec-ec789d77e9af', 'd3d03858-6482-4e68-909c-7beac256b910', '95dad121-8201-4920-861e-fc9ae1fae66b'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:47 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ae46f43c-b0dd-441c-b280-687b9822808e tempest-SnapshotDependencyTests-1230379811 None] Delete snapshot completed successfully. Nov 03 07:42:47 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ae46f43c-b0dd-441c-b280-687b9822808e tempest-SnapshotDependencyTests-1230379811 None] Lock "cinder-bf5e1f01-0619-44fb-8d51-2db1c5e3610c-delete_snapshot" released by "delete_snapshot" :: held 3.163s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:47 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Flow 'volume_create_manager' (e5657626-8a0f-44fa-a37e-bdbf80d84451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62378f11-93e5-49d1-99f1-d168adbc0078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62378f11-93e5-49d1-99f1-d168adbc0078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1877671251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c793a48-d17a-404b-923d-cec742d00278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc7ce2f5ca64d04a65d89c6ed75af6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ef55c004-94c2-4700-9c63-97b29ee55b49,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:48Z,use_quota=True,user_id='a792d4991bb14209abaf1cebea6a5083',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72833282-307c-4524-a857-79312aca1c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72833282-307c-4524-a857-79312aca1c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e06c29-f9ba-405c-855f-6219b44cd1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e06c29-f9ba-405c-855f-6219b44cd1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2c793a48-d17a-404b-923d-cec742d00278', 'volume_name': 'volume-2c793a48-d17a-404b-923d-cec742d00278', 'volume_size': 1, 'snapshot_id': 'ef55c004-94c2-4700-9c63-97b29ee55b49'}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d9530b-23e0-45d1-9ff6-448aae2ea817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d9530b-23e0-45d1-9ff6-448aae2ea817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (929e3555-a25d-4d9e-9eb3-c9261eb8b7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:48 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Volume 2c793a48-d17a-404b-923d-cec742d00278: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2c793a48-d17a-404b-923d-cec742d00278', 'volume_size': 1, 'snapshot_id': 'ef55c004-94c2-4700-9c63-97b29ee55b49'} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Acquiring lock "cinder-quobyte-ef55c004-94c2-4700-9c63-97b29ee55b49-2c793a48-d17a-404b-923d-cec742d00278" by "_create_volume_from_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Lock "cinder-quobyte-ef55c004-94c2-4700-9c63-97b29ee55b49-2c793a48-d17a-404b-923d-cec742d00278" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Creating volume 2c793a48-d17a-404b-923d-cec742d00278 from snapshot ef55c004-94c2-4700-9c63-97b29ee55b49 {{(pid=87016) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Acquiring lock "cinder-quobyte-2c793a48-d17a-404b-923d-cec742d00278" by "_copy_volume_from_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Lock "cinder-quobyte-2c793a48-d17a-404b-923d-cec742d00278" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] snapshot: ef55c004-94c2-4700-9c63-97b29ee55b49, volume: 2c793a48-d17a-404b-923d-cec742d00278, {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3b76a4-175c-4d7f-aa6a-3912a37a2589]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.ef55c004-94c2-4700-9c63-97b29ee55b49 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:48 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.ef55c004-94c2-4700-9c63-97b29ee55b49 Nov 03 07:42:48 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:48 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.ef55c004-94c2-4700-9c63-97b29ee55b49" returned: 0 in 0.361s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7787618d-e362-4936-be22-9e73a5890d90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed308eef-ab13-499b-89d8-d04cf6477c42]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:48 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90 Nov 03 07:42:48 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d67fb893-a807-42d1-a7fe-eecc15046b6a tempest-SnapshotDependencyTests-1230379811 None] Acquiring lock "cinder-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d67fb893-a807-42d1-a7fe-eecc15046b6a tempest-SnapshotDependencyTests-1230379811 None] Lock "cinder-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d67fb893-a807-42d1-a7fe-eecc15046b6a tempest-SnapshotDependencyTests-1230379811 None] Acquiring lock "cinder-quobyte-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d67fb893-a807-42d1-a7fe-eecc15046b6a tempest-SnapshotDependencyTests-1230379811 None] Lock "cinder-quobyte-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce" acquired by "delete_volume" :: waited 0.020s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4047cce-d10e-4bb7-9afa-5005bdacbe39]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d67fb893-a807-42d1-a7fe-eecc15046b6a tempest-SnapshotDependencyTests-1230379811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:49 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce Nov 03 07:42:49 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:49 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90" returned: 0 in 0.488s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90 {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:42:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Creating direct copy from snapshot {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:42:49 devstack cinder-volume[87016]: DEBUG cinder.utils [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Path /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2c793a48-d17a-404b-923d-cec742d00278 not found in is_blk_device check {{(pid=87016) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 07:42:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2c793a48-d17a-404b-923d-cec742d00278 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:49 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2c793a48-d17a-404b-923d-cec742d00278 Nov 03 07:42:49 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:42:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:49 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:42:49 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:49 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d67fb893-a807-42d1-a7fe-eecc15046b6a tempest-SnapshotDependencyTests-1230379811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce" returned: 0 in 0.407s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d67fb893-a807-42d1-a7fe-eecc15046b6a tempest-SnapshotDependencyTests-1230379811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:49 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce Nov 03 07:42:49 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:49 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.280s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:42:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 28 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:42:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:42:49 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d67fb893-a807-42d1-a7fe-eecc15046b6a tempest-SnapshotDependencyTests-1230379811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce" returned: 0 in 0.337s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:49 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d67fb893-a807-42d1-a7fe-eecc15046b6a tempest-SnapshotDependencyTests-1230379811 None] Lock "cinder-quobyte-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce" released by "delete_volume" :: held 0.850s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:50 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-d67fb893-a807-42d1-a7fe-eecc15046b6a tempest-SnapshotDependencyTests-1230379811 None] Created reservations ['5859ebd5-1b3d-4195-bb69-0fd80be8f169', 'dfb6f8c9-d681-4771-bb0d-fa46bc0f2880', 'ba87ba18-513f-4ea4-b736-12be65c673c0', 'db2edc43-271a-4596-b8f7-f3ff49c90a2b'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d67fb893-a807-42d1-a7fe-eecc15046b6a tempest-SnapshotDependencyTests-1230379811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d67fb893-a807-42d1-a7fe-eecc15046b6a tempest-SnapshotDependencyTests-1230379811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d67fb893-a807-42d1-a7fe-eecc15046b6a tempest-SnapshotDependencyTests-1230379811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d67fb893-a807-42d1-a7fe-eecc15046b6a tempest-SnapshotDependencyTests-1230379811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d67fb893-a807-42d1-a7fe-eecc15046b6a tempest-SnapshotDependencyTests-1230379811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d67fb893-a807-42d1-a7fe-eecc15046b6a tempest-SnapshotDependencyTests-1230379811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:51 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:42:51 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:51 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d67fb893-a807-42d1-a7fe-eecc15046b6a tempest-SnapshotDependencyTests-1230379811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.517s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:51 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-d67fb893-a807-42d1-a7fe-eecc15046b6a tempest-SnapshotDependencyTests-1230379811 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:51 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-d67fb893-a807-42d1-a7fe-eecc15046b6a tempest-SnapshotDependencyTests-1230379811 None] Deleted volume successfully. Nov 03 07:42:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d67fb893-a807-42d1-a7fe-eecc15046b6a tempest-SnapshotDependencyTests-1230379811 None] Lock "cinder-52eb0cf4-38f1-4a45-868a-d76ae7d6a0ce-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-247d346d-9a17-48d6-bd8d-ffe58dc7312e tempest-SnapshotDependencyTests-1230379811 None] Acquiring lock "cinder-6bc285b8-38e8-48f0-a7c9-891269ec3722-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-247d346d-9a17-48d6-bd8d-ffe58dc7312e tempest-SnapshotDependencyTests-1230379811 None] Lock "cinder-6bc285b8-38e8-48f0-a7c9-891269ec3722-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-247d346d-9a17-48d6-bd8d-ffe58dc7312e tempest-SnapshotDependencyTests-1230379811 None] Acquiring lock "cinder-quobyte-6bc285b8-38e8-48f0-a7c9-891269ec3722" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-247d346d-9a17-48d6-bd8d-ffe58dc7312e tempest-SnapshotDependencyTests-1230379811 None] Lock "cinder-quobyte-6bc285b8-38e8-48f0-a7c9-891269ec3722" acquired by "delete_volume" :: waited 0.039s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:52 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fbea44-c89b-416e-a7af-9d1b1395c3b8]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-247d346d-9a17-48d6-bd8d-ffe58dc7312e tempest-SnapshotDependencyTests-1230379811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6bc285b8-38e8-48f0-a7c9-891269ec3722 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:52 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6bc285b8-38e8-48f0-a7c9-891269ec3722 Nov 03 07:42:52 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:53 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-247d346d-9a17-48d6-bd8d-ffe58dc7312e tempest-SnapshotDependencyTests-1230379811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6bc285b8-38e8-48f0-a7c9-891269ec3722" returned: 0 in 0.777s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-247d346d-9a17-48d6-bd8d-ffe58dc7312e tempest-SnapshotDependencyTests-1230379811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6bc285b8-38e8-48f0-a7c9-891269ec3722 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:53 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6bc285b8-38e8-48f0-a7c9-891269ec3722 Nov 03 07:42:53 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:53 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-247d346d-9a17-48d6-bd8d-ffe58dc7312e tempest-SnapshotDependencyTests-1230379811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6bc285b8-38e8-48f0-a7c9-891269ec3722" returned: 0 in 0.665s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-247d346d-9a17-48d6-bd8d-ffe58dc7312e tempest-SnapshotDependencyTests-1230379811 None] Lock "cinder-quobyte-6bc285b8-38e8-48f0-a7c9-891269ec3722" released by "delete_volume" :: held 1.572s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:54 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-247d346d-9a17-48d6-bd8d-ffe58dc7312e tempest-SnapshotDependencyTests-1230379811 None] Created reservations ['d4d8dbc7-a79b-429b-afdf-95e4c80530c0', '05735419-d2b0-4772-90bc-f513ed6083a2', '00c604fa-adc1-4ece-93fd-82a0e03e20f5', '6c81ba60-5e8d-4894-abe5-964706fa8ae9'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-247d346d-9a17-48d6-bd8d-ffe58dc7312e tempest-SnapshotDependencyTests-1230379811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-247d346d-9a17-48d6-bd8d-ffe58dc7312e tempest-SnapshotDependencyTests-1230379811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-247d346d-9a17-48d6-bd8d-ffe58dc7312e tempest-SnapshotDependencyTests-1230379811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-247d346d-9a17-48d6-bd8d-ffe58dc7312e tempest-SnapshotDependencyTests-1230379811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-247d346d-9a17-48d6-bd8d-ffe58dc7312e tempest-SnapshotDependencyTests-1230379811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-247d346d-9a17-48d6-bd8d-ffe58dc7312e tempest-SnapshotDependencyTests-1230379811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:54 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:42:54 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:55 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-247d346d-9a17-48d6-bd8d-ffe58dc7312e tempest-SnapshotDependencyTests-1230379811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.943s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:55 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-247d346d-9a17-48d6-bd8d-ffe58dc7312e tempest-SnapshotDependencyTests-1230379811 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:55 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-247d346d-9a17-48d6-bd8d-ffe58dc7312e tempest-SnapshotDependencyTests-1230379811 None] Deleted volume successfully. Nov 03 07:42:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-247d346d-9a17-48d6-bd8d-ffe58dc7312e tempest-SnapshotDependencyTests-1230379811 None] Lock "cinder-6bc285b8-38e8-48f0-a7c9-891269ec3722-delete_volume" released by "delete_volume" :: held 3.174s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:58 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2c793a48-d17a-404b-923d-cec742d00278" returned: 0 in 9.062s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:58 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Image conversion details: src /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90, size 1024.00 MB, duration 9.06 sec, destination /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2c793a48-d17a-404b-923d-cec742d00278 {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:42:58 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Converted 1024.00 MB image at 112.98 MB/s Nov 03 07:42:58 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2c793a48-d17a-404b-923d-cec742d00278 is being set with open permissions: ugo+rw Nov 03 07:42:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2c793a48-d17a-404b-923d-cec742d00278 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:58 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2c793a48-d17a-404b-923d-cec742d00278 Nov 03 07:42:58 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:58 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2c793a48-d17a-404b-923d-cec742d00278" returned: 0 in 0.357s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:58 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Lock "cinder-quobyte-2c793a48-d17a-404b-923d-cec742d00278" released by "_copy_volume_from_snapshot" :: held 10.375s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:58 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Lock "cinder-quobyte-ef55c004-94c2-4700-9c63-97b29ee55b49-2c793a48-d17a-404b-923d-cec742d00278" released by "_create_volume_from_snapshot" :: held 10.458s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.478s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (929e3555-a25d-4d9e-9eb3-c9261eb8b7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c793a48-d17a-404b-923d-cec742d00278', 'volume_size': 1, 'snapshot_id': 'ef55c004-94c2-4700-9c63-97b29ee55b49'}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ed03d7-fb8d-4485-8cb9-a99b7565cd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:58 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Volume volume-2c793a48-d17a-404b-923d-cec742d00278 (2c793a48-d17a-404b-923d-cec742d00278): created successfully Nov 03 07:42:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ed03d7-fb8d-4485-8cb9-a99b7565cd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:58 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Flow 'volume_create_manager' (e5657626-8a0f-44fa-a37e-bdbf80d84451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:58 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-88655ad4-3b0f-4a94-b27f-f341526b514b tempest-TestStampPattern-1301464608 None] Created volume successfully. Nov 03 07:43:08 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:UPDATE=32,cinder:SELECT=39,cinder:INSERT=11,cinder:DELETE=4 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:43:08 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=40,cinder:UPDATE=39,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:43:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-ff7cd902-2952-4356-84c0-cf20b87a7c60 req-833e312f-c268-4bf4-9a33-850849f811b3 tempest-TestStampPattern-1301464608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-ff7cd902-2952-4356-84c0-cf20b87a7c60 req-833e312f-c268-4bf4-9a33-850849f811b3 tempest-TestStampPattern-1301464608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [req-ff7cd902-2952-4356-84c0-cf20b87a7c60 req-833e312f-c268-4bf4-9a33-850849f811b3 tempest-TestStampPattern-1301464608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-ff7cd902-2952-4356-84c0-cf20b87a7c60 req-833e312f-c268-4bf4-9a33-850849f811b3 tempest-TestStampPattern-1301464608 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14', 'name': 'volume-2c793a48-d17a-404b-923d-cec742d00278', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fac731ae-bd2e-4d8e-8714-27ba171702d3', 'enforce_multipath': True} {{(pid=87016) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:43:42 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-ff7cd902-2952-4356-84c0-cf20b87a7c60 req-833e312f-c268-4bf4-9a33-850849f811b3 tempest-TestStampPattern-1301464608 None] attachment_update completed successfully. Nov 03 07:43:45 devstack cinder-volume[87016]: INFO cinder.volume.manager [req-9cc90fdd-f7d4-4595-90c3-1ecfd705c4b3 req-47ea91b8-8972-4c9e-83af-d5973160d436 tempest-TestStampPattern-1301464608 None] Terminate volume connection completed successfully. Nov 03 07:43:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [req-9cc90fdd-f7d4-4595-90c3-1ecfd705c4b3 req-47ea91b8-8972-4c9e-83af-d5973160d436 tempest-TestStampPattern-1301464608 None] Deleting attachment fac731ae-bd2e-4d8e-8714-27ba171702d3. {{(pid=87016) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:43:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:43:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:43:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:43:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:49 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:43:49 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:49 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.296s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:43:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:43:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 28 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:43:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:43:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2da7a84c-aed7-401d-a0ff-d65fc2065374 tempest-TestStampPattern-1301464608 None] Acquiring lock "cinder-2c793a48-d17a-404b-923d-cec742d00278-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2da7a84c-aed7-401d-a0ff-d65fc2065374 tempest-TestStampPattern-1301464608 None] Lock "cinder-2c793a48-d17a-404b-923d-cec742d00278-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2da7a84c-aed7-401d-a0ff-d65fc2065374 tempest-TestStampPattern-1301464608 None] Acquiring lock "cinder-quobyte-2c793a48-d17a-404b-923d-cec742d00278" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2da7a84c-aed7-401d-a0ff-d65fc2065374 tempest-TestStampPattern-1301464608 None] Lock "cinder-quobyte-2c793a48-d17a-404b-923d-cec742d00278" acquired by "delete_volume" :: waited 0.020s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:50 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8aeb153-a118-4a01-9638-24af354525ea]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2da7a84c-aed7-401d-a0ff-d65fc2065374 tempest-TestStampPattern-1301464608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2c793a48-d17a-404b-923d-cec742d00278 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:50 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2c793a48-d17a-404b-923d-cec742d00278 Nov 03 07:43:50 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:50 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2da7a84c-aed7-401d-a0ff-d65fc2065374 tempest-TestStampPattern-1301464608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2c793a48-d17a-404b-923d-cec742d00278" returned: 0 in 0.357s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2da7a84c-aed7-401d-a0ff-d65fc2065374 tempest-TestStampPattern-1301464608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2c793a48-d17a-404b-923d-cec742d00278 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:50 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2c793a48-d17a-404b-923d-cec742d00278 Nov 03 07:43:50 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:50 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2da7a84c-aed7-401d-a0ff-d65fc2065374 tempest-TestStampPattern-1301464608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2c793a48-d17a-404b-923d-cec742d00278" returned: 0 in 0.300s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2da7a84c-aed7-401d-a0ff-d65fc2065374 tempest-TestStampPattern-1301464608 None] Lock "cinder-quobyte-2c793a48-d17a-404b-923d-cec742d00278" released by "delete_volume" :: held 0.715s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:50 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-2da7a84c-aed7-401d-a0ff-d65fc2065374 tempest-TestStampPattern-1301464608 None] Created reservations ['27973e99-35f0-41ad-abd5-f227a7ea47ae', 'd6ecb312-6eca-4cc6-aa2f-482c928996a7', '0967f37a-fdce-4b4a-8d36-65ab13d73f17', '82bdc5d4-0787-4de0-8aea-e1053b4685bf'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:43:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2da7a84c-aed7-401d-a0ff-d65fc2065374 tempest-TestStampPattern-1301464608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2da7a84c-aed7-401d-a0ff-d65fc2065374 tempest-TestStampPattern-1301464608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2da7a84c-aed7-401d-a0ff-d65fc2065374 tempest-TestStampPattern-1301464608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:43:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2da7a84c-aed7-401d-a0ff-d65fc2065374 tempest-TestStampPattern-1301464608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:43:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2da7a84c-aed7-401d-a0ff-d65fc2065374 tempest-TestStampPattern-1301464608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2da7a84c-aed7-401d-a0ff-d65fc2065374 tempest-TestStampPattern-1301464608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:51 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:43:51 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:51 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2da7a84c-aed7-401d-a0ff-d65fc2065374 tempest-TestStampPattern-1301464608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.246s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:51 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-2da7a84c-aed7-401d-a0ff-d65fc2065374 tempest-TestStampPattern-1301464608 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:43:51 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-2da7a84c-aed7-401d-a0ff-d65fc2065374 tempest-TestStampPattern-1301464608 None] Deleted volume successfully. Nov 03 07:43:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2da7a84c-aed7-401d-a0ff-d65fc2065374 tempest-TestStampPattern-1301464608 None] Lock "cinder-2c793a48-d17a-404b-923d-cec742d00278-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-dde036c4-b425-4c57-952d-9e20187bc9db tempest-TestStampPattern-1301464608 None] Acquiring lock "cinder-ef55c004-94c2-4700-9c63-97b29ee55b49-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-dde036c4-b425-4c57-952d-9e20187bc9db tempest-TestStampPattern-1301464608 None] Lock "cinder-ef55c004-94c2-4700-9c63-97b29ee55b49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-dde036c4-b425-4c57-952d-9e20187bc9db tempest-TestStampPattern-1301464608 None] Acquiring lock "cinder-quobyte-7787618d-e362-4936-be22-9e73a5890d90" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-dde036c4-b425-4c57-952d-9e20187bc9db tempest-TestStampPattern-1301464608 None] Lock "cinder-quobyte-7787618d-e362-4936-be22-9e73a5890d90" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-dde036c4-b425-4c57-952d-9e20187bc9db tempest-TestStampPattern-1301464608 None] Acquiring lock "cinder-quobyte-ef55c004-94c2-4700-9c63-97b29ee55b49" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-dde036c4-b425-4c57-952d-9e20187bc9db tempest-TestStampPattern-1301464608 None] Lock "cinder-quobyte-ef55c004-94c2-4700-9c63-97b29ee55b49" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-dde036c4-b425-4c57-952d-9e20187bc9db tempest-TestStampPattern-1301464608 None] Deleting offline snapshot ef55c004-94c2-4700-9c63-97b29ee55b49 of volume 7787618d-e362-4936-be22-9e73a5890d90 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:43:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-dde036c4-b425-4c57-952d-9e20187bc9db tempest-TestStampPattern-1301464608 None] snapshot_file for this snap is: volume-7787618d-e362-4936-be22-9e73a5890d90.ef55c004-94c2-4700-9c63-97b29ee55b49 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:43:51 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d01069-f349-41c7-84ad-b504afa1d3ff]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dde036c4-b425-4c57-952d-9e20187bc9db tempest-TestStampPattern-1301464608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.ef55c004-94c2-4700-9c63-97b29ee55b49 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:51 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.ef55c004-94c2-4700-9c63-97b29ee55b49 Nov 03 07:43:51 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:52 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dde036c4-b425-4c57-952d-9e20187bc9db tempest-TestStampPattern-1301464608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.ef55c004-94c2-4700-9c63-97b29ee55b49" returned: 0 in 0.397s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-dde036c4-b425-4c57-952d-9e20187bc9db tempest-TestStampPattern-1301464608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7787618d-e362-4936-be22-9e73a5890d90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:43:52 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[f533aabc-862d-4aeb-88d6-0b36a4ac110d]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dde036c4-b425-4c57-952d-9e20187bc9db tempest-TestStampPattern-1301464608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:52 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90 Nov 03 07:43:52 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:52 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dde036c4-b425-4c57-952d-9e20187bc9db tempest-TestStampPattern-1301464608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90" returned: 0 in 0.623s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dde036c4-b425-4c57-952d-9e20187bc9db tempest-TestStampPattern-1301464608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.ef55c004-94c2-4700-9c63-97b29ee55b49 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:52 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.ef55c004-94c2-4700-9c63-97b29ee55b49 Nov 03 07:43:52 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:53 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dde036c4-b425-4c57-952d-9e20187bc9db tempest-TestStampPattern-1301464608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.ef55c004-94c2-4700-9c63-97b29ee55b49" returned: 0 in 0.362s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dde036c4-b425-4c57-952d-9e20187bc9db tempest-TestStampPattern-1301464608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.ef55c004-94c2-4700-9c63-97b29ee55b49 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:53 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.ef55c004-94c2-4700-9c63-97b29ee55b49 Nov 03 07:43:53 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:53 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-dde036c4-b425-4c57-952d-9e20187bc9db tempest-TestStampPattern-1301464608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90.ef55c004-94c2-4700-9c63-97b29ee55b49" returned: 0 in 0.268s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-dde036c4-b425-4c57-952d-9e20187bc9db tempest-TestStampPattern-1301464608 None] Lock "cinder-quobyte-ef55c004-94c2-4700-9c63-97b29ee55b49" released by "_delete_snapshot" :: held 1.770s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-dde036c4-b425-4c57-952d-9e20187bc9db tempest-TestStampPattern-1301464608 None] Lock "cinder-quobyte-7787618d-e362-4936-be22-9e73a5890d90" released by "delete_snapshot" :: held 1.792s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:53 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-dde036c4-b425-4c57-952d-9e20187bc9db tempest-TestStampPattern-1301464608 None] Created reservations ['28fbc882-53e5-4495-aeac-c9778d249900', '808a184a-2c1c-45ba-8d8d-f04b9fefc0c4', 'b228f249-e1ae-4058-bb79-8c8a41780e1a', '2fc63d28-7a9c-4d18-b59a-63c63447e942'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:43:53 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-dde036c4-b425-4c57-952d-9e20187bc9db tempest-TestStampPattern-1301464608 None] Delete snapshot completed successfully. Nov 03 07:43:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-dde036c4-b425-4c57-952d-9e20187bc9db tempest-TestStampPattern-1301464608 None] Lock "cinder-ef55c004-94c2-4700-9c63-97b29ee55b49-delete_snapshot" released by "delete_snapshot" :: held 1.925s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-44fa48af-1c89-4ad1-a170-9ad26359cb78 tempest-TestStampPattern-1301464608 None] Acquiring lock "cinder-7787618d-e362-4936-be22-9e73a5890d90-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-44fa48af-1c89-4ad1-a170-9ad26359cb78 tempest-TestStampPattern-1301464608 None] Lock "cinder-7787618d-e362-4936-be22-9e73a5890d90-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-44fa48af-1c89-4ad1-a170-9ad26359cb78 tempest-TestStampPattern-1301464608 None] Acquiring lock "cinder-quobyte-7787618d-e362-4936-be22-9e73a5890d90" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-44fa48af-1c89-4ad1-a170-9ad26359cb78 tempest-TestStampPattern-1301464608 None] Lock "cinder-quobyte-7787618d-e362-4936-be22-9e73a5890d90" acquired by "delete_volume" :: waited 0.014s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:57 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[84230a86-13e8-4e3f-ab08-441fc2aac6b0]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-44fa48af-1c89-4ad1-a170-9ad26359cb78 tempest-TestStampPattern-1301464608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:57 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90 Nov 03 07:43:57 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:57 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-44fa48af-1c89-4ad1-a170-9ad26359cb78 tempest-TestStampPattern-1301464608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90" returned: 0 in 0.376s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-44fa48af-1c89-4ad1-a170-9ad26359cb78 tempest-TestStampPattern-1301464608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:57 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90 Nov 03 07:43:57 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:57 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-44fa48af-1c89-4ad1-a170-9ad26359cb78 tempest-TestStampPattern-1301464608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7787618d-e362-4936-be22-9e73a5890d90" returned: 0 in 0.238s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-44fa48af-1c89-4ad1-a170-9ad26359cb78 tempest-TestStampPattern-1301464608 None] Lock "cinder-quobyte-7787618d-e362-4936-be22-9e73a5890d90" released by "delete_volume" :: held 0.675s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:57 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-44fa48af-1c89-4ad1-a170-9ad26359cb78 tempest-TestStampPattern-1301464608 None] Created reservations ['ef669132-08be-4092-a7f7-25d71eb6f35b', 'd34810a3-cbbe-4daf-9420-846a20384e21', 'bc2e9be2-4f7c-4c53-a809-1907ce108e22', 'a7c31fbc-c98a-447e-bf32-ae7082463194'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:43:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-44fa48af-1c89-4ad1-a170-9ad26359cb78 tempest-TestStampPattern-1301464608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-44fa48af-1c89-4ad1-a170-9ad26359cb78 tempest-TestStampPattern-1301464608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-44fa48af-1c89-4ad1-a170-9ad26359cb78 tempest-TestStampPattern-1301464608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:43:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-44fa48af-1c89-4ad1-a170-9ad26359cb78 tempest-TestStampPattern-1301464608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:43:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-44fa48af-1c89-4ad1-a170-9ad26359cb78 tempest-TestStampPattern-1301464608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-44fa48af-1c89-4ad1-a170-9ad26359cb78 tempest-TestStampPattern-1301464608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:58 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:43:58 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:58 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-44fa48af-1c89-4ad1-a170-9ad26359cb78 tempest-TestStampPattern-1301464608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.272s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:58 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-44fa48af-1c89-4ad1-a170-9ad26359cb78 tempest-TestStampPattern-1301464608 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:43:58 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-44fa48af-1c89-4ad1-a170-9ad26359cb78 tempest-TestStampPattern-1301464608 None] Deleted volume successfully. Nov 03 07:43:58 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-44fa48af-1c89-4ad1-a170-9ad26359cb78 tempest-TestStampPattern-1301464608 None] Lock "cinder-7787618d-e362-4936-be22-9e73a5890d90-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:08 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=25,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:44:08 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=21,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:44:14 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Flow 'volume_create_manager' (4d1c5683-a803-44ce-998b-463eb3e1568d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cabe7f7e-ddd9-4bdd-8314-7a43a8db9fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cabe7f7e-ddd9-4bdd-8314-7a43a8db9fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10576812-35b7-44d6-a700-c400d98f473a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c825f26cc0e497db15df3d016c7a6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:14Z,use_quota=True,user_id='f194bd1f138f476fadbe1693424fd6b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(926c0def-a248-48ef-8e56-0f300494a063),volume_type_id=926c0def-a248-48ef-8e56-0f300494a063)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db5fa24-dd6b-4e17-9d3e-3ea039572697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db5fa24-dd6b-4e17-9d3e-3ea039572697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1177a70c-e8a5-464a-a5f6-e86df1a02692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:14 devstack cinder-volume[87016]: DEBUG cinder.image.glance [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Creating Keystone auth plugin from conf {{(pid=87016) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:44:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1177a70c-e8a5-464a-a5f6-e86df1a02692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '10576812-35b7-44d6-a700-c400d98f473a', 'volume_name': 'volume-10576812-35b7-44d6-a700-c400d98f473a', 'volume_size': 1, 'image_id': '836c2fbf-3fff-44d7-babc-00f325234ba9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/836c2fbf-3fff-44d7-babc-00f325234ba9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e757eb7d0c8892a591a07465132b63e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0c825f26cc0e497db15df3d016c7a6c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b49568947ae82348da971df226cf662a7111406d425a033d8e759099aacd16e5011922accd5c04bdef2e6006e890366726b6ccb7ee6ca99ff278b4376c67e22', 'id': '836c2fbf-3fff-44d7-babc-00f325234ba9', 'created_at': datetime.datetime(2026, 11, 3, 6, 44, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 44, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/836c2fbf-3fff-44d7-babc-00f325234ba9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7751a79-f1bc-4edf-a207-1ebf85c6fdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7751a79-f1bc-4edf-a207-1ebf85c6fdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e446f1-d112-4fda-8e1d-822254f4973d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:14 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Volume 10576812-35b7-44d6-a700-c400d98f473a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-10576812-35b7-44d6-a700-c400d98f473a', 'volume_size': 1, 'image_id': '836c2fbf-3fff-44d7-babc-00f325234ba9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/836c2fbf-3fff-44d7-babc-00f325234ba9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e757eb7d0c8892a591a07465132b63e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0c825f26cc0e497db15df3d016c7a6c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b49568947ae82348da971df226cf662a7111406d425a033d8e759099aacd16e5011922accd5c04bdef2e6006e890366726b6ccb7ee6ca99ff278b4376c67e22', 'id': '836c2fbf-3fff-44d7-babc-00f325234ba9', 'created_at': datetime.datetime(2026, 11, 3, 6, 44, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 44, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/836c2fbf-3fff-44d7-babc-00f325234ba9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 07:44:14 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Trying to clone 10576812-35b7-44d6-a700-c400d98f473a from image 836c2fbf-3fff-44d7-babc-00f325234ba9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/836c2fbf-3fff-44d7-babc-00f325234ba9', 'metadata': {}}]). {{(pid=87016) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:44:14 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:44:14 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Image download 0.00 MB at 0.00 MB/s Nov 03 07:44:14 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25fbb58-d464-41a4-9a0e-8085f46d5b70]: (4, 'raw') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:15 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD Nov 03 07:44:15 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:15 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:15 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD Nov 03 07:44:15 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:15 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD" returned: 1 in 0.353s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:44:15 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Temporary image 836c2fbf-3fff-44d7-babc-00f325234ba9 is fetched for user f194bd1f138f476fadbe1693424fd6b9. {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:44:15 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf9bf80-2e22-410b-9bf7-ecff6ed51e48]: (4, 'raw') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:15 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD Nov 03 07:44:15 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:16 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:16 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD Nov 03 07:44:16 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:16 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD" returned: 1 in 0.347s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:44:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10576812-35b7-44d6-a700-c400d98f473a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c825f26cc0e497db15df3d016c7a6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:14Z,use_quota=True,user_id='f194bd1f138f476fadbe1693424fd6b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(926c0def-a248-48ef-8e56-0f300494a063),volume_type_id=926c0def-a248-48ef-8e56-0f300494a063)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:44:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Creating volume 10576812-35b7-44d6-a700-c400d98f473a {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:44:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:16 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:44:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-10576812-35b7-44d6-a700-c400d98f473a 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:16 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-10576812-35b7-44d6-a700-c400d98f473a 1073741824 Nov 03 07:44:16 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:16 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-10576812-35b7-44d6-a700-c400d98f473a 1073741824" returned: 0 in 0.419s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-10576812-35b7-44d6-a700-c400d98f473a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:16 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-10576812-35b7-44d6-a700-c400d98f473a Nov 03 07:44:16 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:17 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-10576812-35b7-44d6-a700-c400d98f473a" returned: 0 in 0.271s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:17 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:44:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:17 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Attempting download of 836c2fbf-3fff-44d7-babc-00f325234ba9 ((None, [{'url': 'file:///opt/stack/data/glance/images/836c2fbf-3fff-44d7-babc-00f325234ba9', 'metadata': {}}])) to volume 10576812-35b7-44d6-a700-c400d98f473a. {{(pid=87016) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 03 07:44:17 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c8aae2-3df1-4d42-986b-beca3524ff9e]: (4, 'raw') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_836c2fbf-3fff-44d7-babc-00f325234ba9_x6kd90n3 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:17 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_836c2fbf-3fff-44d7-babc-00f325234ba9_x6kd90n3 Nov 03 07:44:17 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:17 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_836c2fbf-3fff-44d7-babc-00f325234ba9_x6kd90n3" returned: 0 in 0.344s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_836c2fbf-3fff-44d7-babc-00f325234ba9_x6kd90n3 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:17 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_836c2fbf-3fff-44d7-babc-00f325234ba9_x6kd90n3 Nov 03 07:44:17 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:17 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_836c2fbf-3fff-44d7-babc-00f325234ba9_x6kd90n3" returned: 1 in 0.325s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_836c2fbf-3fff-44d7-babc-00f325234ba9_x6kd90n3' failed. Not Retrying. {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:44:17 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad473ae-e0e9-4c76-9cab-df906d5044a2]: (4, 'raw') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:17 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD Nov 03 07:44:17 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:18 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD" returned: 0 in 0.331s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:18 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD Nov 03 07:44:18 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:18 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD" returned: 1 in 0.304s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:44:18 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] 836c2fbf-3fff-44d7-babc-00f325234ba9 was raw, converting to qcow2 {{(pid=87016) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:44:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-10576812-35b7-44d6-a700-c400d98f473a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:18 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-10576812-35b7-44d6-a700-c400d98f473a Nov 03 07:44:18 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:18 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-10576812-35b7-44d6-a700-c400d98f473a" returned: 0 in 0.398s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:18 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_836c2fbf-3fff-44d7-babc-00f325234ba9_gedzkok4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-10576812-35b7-44d6-a700-c400d98f473a {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:44:18 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 07:44:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-10576812-35b7-44d6-a700-c400d98f473a 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:18 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-10576812-35b7-44d6-a700-c400d98f473a 1G Nov 03 07:44:18 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:19 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-10576812-35b7-44d6-a700-c400d98f473a 1G" returned: 0 in 0.290s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:19 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Downloaded image 836c2fbf-3fff-44d7-babc-00f325234ba9 ((None, [{'url': 'file:///opt/stack/data/glance/images/836c2fbf-3fff-44d7-babc-00f325234ba9', 'metadata': {}}])) to volume 10576812-35b7-44d6-a700-c400d98f473a successfully. {{(pid=87016) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 03 07:44:19 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Temporary image 836c2fbf-3fff-44d7-babc-00f325234ba9 for user f194bd1f138f476fadbe1693424fd6b9 is deleted. {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:44:19 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Marking volume 10576812-35b7-44d6-a700-c400d98f473a as bootable. {{(pid=87016) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 03 07:44:19 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Copying metadata from image 836c2fbf-3fff-44d7-babc-00f325234ba9 to 10576812-35b7-44d6-a700-c400d98f473a. {{(pid=87016) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:44:19 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Creating volume glance metadata for volume 10576812-35b7-44d6-a700-c400d98f473a backed by image 836c2fbf-3fff-44d7-babc-00f325234ba9 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '836c2fbf-3fff-44d7-babc-00f325234ba9', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e757eb7d0c8892a591a07465132b63e5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87016) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:44:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e446f1-d112-4fda-8e1d-822254f4973d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10576812-35b7-44d6-a700-c400d98f473a', 'volume_size': 1, 'image_id': '836c2fbf-3fff-44d7-babc-00f325234ba9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/836c2fbf-3fff-44d7-babc-00f325234ba9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e757eb7d0c8892a591a07465132b63e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0c825f26cc0e497db15df3d016c7a6c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b49568947ae82348da971df226cf662a7111406d425a033d8e759099aacd16e5011922accd5c04bdef2e6006e890366726b6ccb7ee6ca99ff278b4376c67e22', 'id': '836c2fbf-3fff-44d7-babc-00f325234ba9', 'created_at': datetime.datetime(2026, 11, 3, 6, 44, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 44, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/836c2fbf-3fff-44d7-babc-00f325234ba9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11509119-f6b4-4403-ae3a-444520589bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:19 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Volume volume-10576812-35b7-44d6-a700-c400d98f473a (10576812-35b7-44d6-a700-c400d98f473a): created successfully Nov 03 07:44:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11509119-f6b4-4403-ae3a-444520589bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Flow 'volume_create_manager' (4d1c5683-a803-44ce-998b-463eb3e1568d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:19 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-7fd9a682-d136-4d31-9c12-ecbf279ee82b tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Created volume successfully. Nov 03 07:44:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-34f436e5-f6e9-47e1-98de-f2d15852ca5d tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Acquiring lock "cinder-10576812-35b7-44d6-a700-c400d98f473a-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-34f436e5-f6e9-47e1-98de-f2d15852ca5d tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Lock "cinder-10576812-35b7-44d6-a700-c400d98f473a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-34f436e5-f6e9-47e1-98de-f2d15852ca5d tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Acquiring lock "cinder-quobyte-10576812-35b7-44d6-a700-c400d98f473a" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-34f436e5-f6e9-47e1-98de-f2d15852ca5d tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Lock "cinder-quobyte-10576812-35b7-44d6-a700-c400d98f473a" acquired by "delete_volume" :: waited 0.016s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:19 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[285176de-a3e5-4d5d-94f6-6cdf96d9cecb]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-34f436e5-f6e9-47e1-98de-f2d15852ca5d tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-10576812-35b7-44d6-a700-c400d98f473a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:19 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-10576812-35b7-44d6-a700-c400d98f473a Nov 03 07:44:19 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:20 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-34f436e5-f6e9-47e1-98de-f2d15852ca5d tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-10576812-35b7-44d6-a700-c400d98f473a" returned: 0 in 0.373s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-34f436e5-f6e9-47e1-98de-f2d15852ca5d tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-10576812-35b7-44d6-a700-c400d98f473a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:20 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-10576812-35b7-44d6-a700-c400d98f473a Nov 03 07:44:20 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:20 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-34f436e5-f6e9-47e1-98de-f2d15852ca5d tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-10576812-35b7-44d6-a700-c400d98f473a" returned: 0 in 0.297s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-34f436e5-f6e9-47e1-98de-f2d15852ca5d tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Lock "cinder-quobyte-10576812-35b7-44d6-a700-c400d98f473a" released by "delete_volume" :: held 0.712s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:20 devstack cinder-volume[87016]: WARNING cinder.quota [None req-34f436e5-f6e9-47e1-98de-f2d15852ca5d tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:44:20 devstack cinder-volume[87016]: WARNING cinder.quota [None req-34f436e5-f6e9-47e1-98de-f2d15852ca5d tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:44:20 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-34f436e5-f6e9-47e1-98de-f2d15852ca5d tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Created reservations ['c64c3228-c19b-419c-9df9-9a024e4c0a94', '79e6d28e-c105-4c0d-824e-09c062977ae4', '2a526ca7-dd70-40d0-8041-8ae6fb0f6634', 'a3ed618b-b1a3-4ae4-9e22-c2b49c8ee351'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-34f436e5-f6e9-47e1-98de-f2d15852ca5d tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-34f436e5-f6e9-47e1-98de-f2d15852ca5d tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:20 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-34f436e5-f6e9-47e1-98de-f2d15852ca5d tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:20 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-34f436e5-f6e9-47e1-98de-f2d15852ca5d tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-34f436e5-f6e9-47e1-98de-f2d15852ca5d tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-34f436e5-f6e9-47e1-98de-f2d15852ca5d tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:20 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:44:20 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:20 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-34f436e5-f6e9-47e1-98de-f2d15852ca5d tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.302s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:20 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-34f436e5-f6e9-47e1-98de-f2d15852ca5d tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:20 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-34f436e5-f6e9-47e1-98de-f2d15852ca5d tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Deleted volume successfully. Nov 03 07:44:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-34f436e5-f6e9-47e1-98de-f2d15852ca5d tempest-VolumeAndVolumeTypeFromImageTest-1220906661 None] Lock "cinder-10576812-35b7-44d6-a700-c400d98f473a-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Flow 'volume_create_manager' (01dc4cc0-a002-4a1a-bc70-5845ad1f8687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d491ff7e-8892-42aa-a37b-b5de8dc1e121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d491ff7e-8892-42aa-a37b-b5de8dc1e121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-109235848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6aa2a85-7449-446b-a26c-d147306a7d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59bfa4bf1b57484d990a8855ff0cd203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:25Z,use_quota=True,user_id='2d8d0ee5eb1a44d1bfcc05739715f48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347961ca-68a8-487a-8e7d-101d35b0b5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347961ca-68a8-487a-8e7d-101d35b0b5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b29fbb-1b93-4318-a6b3-c8ac80cdb442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b29fbb-1b93-4318-a6b3-c8ac80cdb442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6aa2a85-7449-446b-a26c-d147306a7d78', 'volume_name': 'volume-d6aa2a85-7449-446b-a26c-d147306a7d78', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1892dcc-1507-4270-a166-20901f081e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1892dcc-1507-4270-a166-20901f081e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6eac47-b565-4845-bf0d-f14683c0e2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:25 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Volume d6aa2a85-7449-446b-a26c-d147306a7d78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6aa2a85-7449-446b-a26c-d147306a7d78', 'volume_size': 1} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-109235848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6aa2a85-7449-446b-a26c-d147306a7d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59bfa4bf1b57484d990a8855ff0cd203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:25Z,use_quota=True,user_id='2d8d0ee5eb1a44d1bfcc05739715f48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Creating volume d6aa2a85-7449-446b-a26c-d147306a7d78 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:25 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:25 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78 1073741824 Nov 03 07:44:25 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:25 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78 1073741824" returned: 0 in 0.401s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:25 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78 Nov 03 07:44:25 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:25 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78" returned: 0 in 0.240s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6eac47-b565-4845-bf0d-f14683c0e2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6aa2a85-7449-446b-a26c-d147306a7d78', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1712d7f-7174-46c4-bbf1-33fc92b45660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:25 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Volume volume-d6aa2a85-7449-446b-a26c-d147306a7d78 (d6aa2a85-7449-446b-a26c-d147306a7d78): created successfully Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1712d7f-7174-46c4-bbf1-33fc92b45660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:25 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Flow 'volume_create_manager' (01dc4cc0-a002-4a1a-bc70-5845ad1f8687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:25 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-cec7d866-eef3-449d-916d-c850e8f7f5b7 tempest-VolumeDependencyTests-1734005399 None] Created volume successfully. Nov 03 07:44:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0170820b-5dd7-447d-8b5a-9a889670928b tempest-VolumeDependencyTests-1734005399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0170820b-5dd7-447d-8b5a-9a889670928b tempest-VolumeDependencyTests-1734005399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-0170820b-5dd7-447d-8b5a-9a889670928b tempest-VolumeDependencyTests-1734005399 None] Creating offline snapshot 5c4747e3-0fc2-4a3a-8ce7-f079ead839d5 of volume d6aa2a85-7449-446b-a26c-d147306a7d78 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:44:26 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[2806c989-a143-432f-8ab3-7867b7d1f603]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0170820b-5dd7-447d-8b5a-9a889670928b tempest-VolumeDependencyTests-1734005399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:26 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78 Nov 03 07:44:26 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:26 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0170820b-5dd7-447d-8b5a-9a889670928b tempest-VolumeDependencyTests-1734005399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78" returned: 0 in 0.362s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0170820b-5dd7-447d-8b5a-9a889670928b tempest-VolumeDependencyTests-1734005399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.5c4747e3-0fc2-4a3a-8ce7-f079ead839d5 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:26 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.5c4747e3-0fc2-4a3a-8ce7-f079ead839d5 1G Nov 03 07:44:26 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:27 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0170820b-5dd7-447d-8b5a-9a889670928b tempest-VolumeDependencyTests-1734005399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.5c4747e3-0fc2-4a3a-8ce7-f079ead839d5 1G" returned: 0 in 0.393s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0170820b-5dd7-447d-8b5a-9a889670928b tempest-VolumeDependencyTests-1734005399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6aa2a85-7449-446b-a26c-d147306a7d78 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.5c4747e3-0fc2-4a3a-8ce7-f079ead839d5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:27 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6aa2a85-7449-446b-a26c-d147306a7d78 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.5c4747e3-0fc2-4a3a-8ce7-f079ead839d5 Nov 03 07:44:27 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:27 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0170820b-5dd7-447d-8b5a-9a889670928b tempest-VolumeDependencyTests-1734005399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6aa2a85-7449-446b-a26c-d147306a7d78 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.5c4747e3-0fc2-4a3a-8ce7-f079ead839d5" returned: 0 in 0.285s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:27 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-0170820b-5dd7-447d-8b5a-9a889670928b tempest-VolumeDependencyTests-1734005399 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.5c4747e3-0fc2-4a3a-8ce7-f079ead839d5 is being set with open permissions: ugo+rw Nov 03 07:44:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0170820b-5dd7-447d-8b5a-9a889670928b tempest-VolumeDependencyTests-1734005399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.5c4747e3-0fc2-4a3a-8ce7-f079ead839d5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:27 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.5c4747e3-0fc2-4a3a-8ce7-f079ead839d5 Nov 03 07:44:27 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:27 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0170820b-5dd7-447d-8b5a-9a889670928b tempest-VolumeDependencyTests-1734005399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.5c4747e3-0fc2-4a3a-8ce7-f079ead839d5" returned: 0 in 0.231s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0170820b-5dd7-447d-8b5a-9a889670928b tempest-VolumeDependencyTests-1734005399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:27 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.info Nov 03 07:44:27 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:27 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0170820b-5dd7-447d-8b5a-9a889670928b tempest-VolumeDependencyTests-1734005399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.info" returned: 0 in 0.239s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:27 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-0170820b-5dd7-447d-8b5a-9a889670928b tempest-VolumeDependencyTests-1734005399 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.info is being set with open permissions: ugo+rw Nov 03 07:44:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0170820b-5dd7-447d-8b5a-9a889670928b tempest-VolumeDependencyTests-1734005399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:27 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.info Nov 03 07:44:27 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:28 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0170820b-5dd7-447d-8b5a-9a889670928b tempest-VolumeDependencyTests-1734005399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.info" returned: 0 in 0.258s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0170820b-5dd7-447d-8b5a-9a889670928b tempest-VolumeDependencyTests-1734005399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.851s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:28 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-0170820b-5dd7-447d-8b5a-9a889670928b tempest-VolumeDependencyTests-1734005399 None] Create snapshot completed successfully Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Flow 'volume_create_manager' (0219e9ee-f7a1-4bd9-9c26-68334dcd155d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb21574-215c-43cb-9247-c22b864ba3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb21574-215c-43cb-9247-c22b864ba3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-773361261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59bfa4bf1b57484d990a8855ff0cd203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5c4747e3-0fc2-4a3a-8ce7-f079ead839d5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:29Z,use_quota=True,user_id='2d8d0ee5eb1a44d1bfcc05739715f48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2a8a68-340e-4c83-b73a-1f888c0116be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2a8a68-340e-4c83-b73a-1f888c0116be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f011548-8e1f-4c31-b4d1-5ba6fe33107b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f011548-8e1f-4c31-b4d1-5ba6fe33107b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5', 'volume_name': 'volume-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5', 'volume_size': 1, 'snapshot_id': '5c4747e3-0fc2-4a3a-8ce7-f079ead839d5'}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56c2ac3-7d08-4ebd-8dbf-189d47474b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56c2ac3-7d08-4ebd-8dbf-189d47474b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e471d8-806c-43e7-84b4-fb4a73b2c440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:29 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Volume 93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5', 'volume_size': 1, 'snapshot_id': '5c4747e3-0fc2-4a3a-8ce7-f079ead839d5'} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Acquiring lock "cinder-quobyte-5c4747e3-0fc2-4a3a-8ce7-f079ead839d5-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5" by "_create_volume_from_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Lock "cinder-quobyte-5c4747e3-0fc2-4a3a-8ce7-f079ead839d5-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Creating volume 93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5 from snapshot 5c4747e3-0fc2-4a3a-8ce7-f079ead839d5 {{(pid=87016) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Acquiring lock "cinder-quobyte-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5" by "_copy_volume_from_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Lock "cinder-quobyte-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] snapshot: 5c4747e3-0fc2-4a3a-8ce7-f079ead839d5, volume: 93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5, {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f47188-fd21-4a60-bc28-479d9db46e7c]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.5c4747e3-0fc2-4a3a-8ce7-f079ead839d5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:29 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.5c4747e3-0fc2-4a3a-8ce7-f079ead839d5 Nov 03 07:44:29 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:29 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.5c4747e3-0fc2-4a3a-8ce7-f079ead839d5" returned: 0 in 0.341s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6aa2a85-7449-446b-a26c-d147306a7d78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ee933f-1fc7-4dc7-97dc-ed1bef734e11]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:29 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78 Nov 03 07:44:29 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:30 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78" returned: 0 in 0.363s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78 {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:44:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Creating direct copy from snapshot {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:44:30 devstack cinder-volume[87016]: DEBUG cinder.utils [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Path /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5 not found in is_blk_device check {{(pid=87016) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 07:44:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:30 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5 Nov 03 07:44:30 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:35 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5" returned: 0 in 5.661s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:35 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Image conversion details: src /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78, size 1024.00 MB, duration 5.66 sec, destination /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5 {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:44:35 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Converted 1024.00 MB image at 180.85 MB/s Nov 03 07:44:35 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5 is being set with open permissions: ugo+rw Nov 03 07:44:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:35 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5 Nov 03 07:44:35 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:36 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5" returned: 0 in 0.239s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Lock "cinder-quobyte-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5" released by "_copy_volume_from_snapshot" :: held 6.684s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Lock "cinder-quobyte-5c4747e3-0fc2-4a3a-8ce7-f079ead839d5-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5" released by "_create_volume_from_snapshot" :: held 6.748s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.765s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e471d8-806c-43e7-84b4-fb4a73b2c440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5', 'volume_size': 1, 'snapshot_id': '5c4747e3-0fc2-4a3a-8ce7-f079ead839d5'}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9332be8a-c2c6-4707-a244-07dfa7fc3bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:36 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Volume volume-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5 (93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5): created successfully Nov 03 07:44:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9332be8a-c2c6-4707-a244-07dfa7fc3bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Flow 'volume_create_manager' (0219e9ee-f7a1-4bd9-9c26-68334dcd155d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:36 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-392e338c-6f93-4e20-aa2a-8e5827c307d6 tempest-VolumeDependencyTests-1734005399 None] Created volume successfully. Nov 03 07:44:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0ab949c9-4827-46f4-a03d-51c55c016ced tempest-VolumeDependencyTests-1734005399 None] Acquiring lock "cinder-5c4747e3-0fc2-4a3a-8ce7-f079ead839d5-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0ab949c9-4827-46f4-a03d-51c55c016ced tempest-VolumeDependencyTests-1734005399 None] Lock "cinder-5c4747e3-0fc2-4a3a-8ce7-f079ead839d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0ab949c9-4827-46f4-a03d-51c55c016ced tempest-VolumeDependencyTests-1734005399 None] Acquiring lock "cinder-quobyte-d6aa2a85-7449-446b-a26c-d147306a7d78" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0ab949c9-4827-46f4-a03d-51c55c016ced tempest-VolumeDependencyTests-1734005399 None] Lock "cinder-quobyte-d6aa2a85-7449-446b-a26c-d147306a7d78" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0ab949c9-4827-46f4-a03d-51c55c016ced tempest-VolumeDependencyTests-1734005399 None] Acquiring lock "cinder-quobyte-5c4747e3-0fc2-4a3a-8ce7-f079ead839d5" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0ab949c9-4827-46f4-a03d-51c55c016ced tempest-VolumeDependencyTests-1734005399 None] Lock "cinder-quobyte-5c4747e3-0fc2-4a3a-8ce7-f079ead839d5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:36 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-0ab949c9-4827-46f4-a03d-51c55c016ced tempest-VolumeDependencyTests-1734005399 None] Deleting offline snapshot 5c4747e3-0fc2-4a3a-8ce7-f079ead839d5 of volume d6aa2a85-7449-446b-a26c-d147306a7d78 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:44:36 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-0ab949c9-4827-46f4-a03d-51c55c016ced tempest-VolumeDependencyTests-1734005399 None] snapshot_file for this snap is: volume-d6aa2a85-7449-446b-a26c-d147306a7d78.5c4747e3-0fc2-4a3a-8ce7-f079ead839d5 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:44:36 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bcfab5-3206-43f3-9b70-ccb6d188b36f]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0ab949c9-4827-46f4-a03d-51c55c016ced tempest-VolumeDependencyTests-1734005399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.5c4747e3-0fc2-4a3a-8ce7-f079ead839d5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:36 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.5c4747e3-0fc2-4a3a-8ce7-f079ead839d5 Nov 03 07:44:36 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:37 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0ab949c9-4827-46f4-a03d-51c55c016ced tempest-VolumeDependencyTests-1734005399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.5c4747e3-0fc2-4a3a-8ce7-f079ead839d5" returned: 0 in 0.380s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:37 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-0ab949c9-4827-46f4-a03d-51c55c016ced tempest-VolumeDependencyTests-1734005399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6aa2a85-7449-446b-a26c-d147306a7d78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:44:37 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d5b6dd-1d04-4431-8eee-6296b7c67d4d]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0ab949c9-4827-46f4-a03d-51c55c016ced tempest-VolumeDependencyTests-1734005399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:37 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78 Nov 03 07:44:37 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:37 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0ab949c9-4827-46f4-a03d-51c55c016ced tempest-VolumeDependencyTests-1734005399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78" returned: 0 in 0.539s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0ab949c9-4827-46f4-a03d-51c55c016ced tempest-VolumeDependencyTests-1734005399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.5c4747e3-0fc2-4a3a-8ce7-f079ead839d5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:37 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.5c4747e3-0fc2-4a3a-8ce7-f079ead839d5 Nov 03 07:44:37 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:37 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0ab949c9-4827-46f4-a03d-51c55c016ced tempest-VolumeDependencyTests-1734005399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.5c4747e3-0fc2-4a3a-8ce7-f079ead839d5" returned: 0 in 0.341s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0ab949c9-4827-46f4-a03d-51c55c016ced tempest-VolumeDependencyTests-1734005399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.5c4747e3-0fc2-4a3a-8ce7-f079ead839d5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:38 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.5c4747e3-0fc2-4a3a-8ce7-f079ead839d5 Nov 03 07:44:38 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:38 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0ab949c9-4827-46f4-a03d-51c55c016ced tempest-VolumeDependencyTests-1734005399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78.5c4747e3-0fc2-4a3a-8ce7-f079ead839d5" returned: 0 in 0.263s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0ab949c9-4827-46f4-a03d-51c55c016ced tempest-VolumeDependencyTests-1734005399 None] Lock "cinder-quobyte-5c4747e3-0fc2-4a3a-8ce7-f079ead839d5" released by "_delete_snapshot" :: held 1.625s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0ab949c9-4827-46f4-a03d-51c55c016ced tempest-VolumeDependencyTests-1734005399 None] Lock "cinder-quobyte-d6aa2a85-7449-446b-a26c-d147306a7d78" released by "delete_snapshot" :: held 1.647s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:38 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-0ab949c9-4827-46f4-a03d-51c55c016ced tempest-VolumeDependencyTests-1734005399 None] Created reservations ['73971ef2-7870-4067-9567-341bfec54b97', '795068e2-43b9-4a85-afc5-e781abc368fb', '51402d0c-530b-4fcd-8669-76ffeeafc673', '5ce6493c-8798-4c85-b2a8-e6553130225c'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:38 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-0ab949c9-4827-46f4-a03d-51c55c016ced tempest-VolumeDependencyTests-1734005399 None] Delete snapshot completed successfully. Nov 03 07:44:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0ab949c9-4827-46f4-a03d-51c55c016ced tempest-VolumeDependencyTests-1734005399 None] Lock "cinder-5c4747e3-0fc2-4a3a-8ce7-f079ead839d5-delete_snapshot" released by "delete_snapshot" :: held 1.791s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-69663bb5-b772-4a8f-bc41-c9bf7919f752 tempest-VolumeDependencyTests-1734005399 None] Acquiring lock "cinder-d6aa2a85-7449-446b-a26c-d147306a7d78-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-69663bb5-b772-4a8f-bc41-c9bf7919f752 tempest-VolumeDependencyTests-1734005399 None] Lock "cinder-d6aa2a85-7449-446b-a26c-d147306a7d78-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-69663bb5-b772-4a8f-bc41-c9bf7919f752 tempest-VolumeDependencyTests-1734005399 None] Acquiring lock "cinder-quobyte-d6aa2a85-7449-446b-a26c-d147306a7d78" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-69663bb5-b772-4a8f-bc41-c9bf7919f752 tempest-VolumeDependencyTests-1734005399 None] Lock "cinder-quobyte-d6aa2a85-7449-446b-a26c-d147306a7d78" acquired by "delete_volume" :: waited 0.015s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:38 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c5032e-9340-42b9-a4e0-fb3c59792d9b]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-69663bb5-b772-4a8f-bc41-c9bf7919f752 tempest-VolumeDependencyTests-1734005399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:39 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78 Nov 03 07:44:39 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:39 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-69663bb5-b772-4a8f-bc41-c9bf7919f752 tempest-VolumeDependencyTests-1734005399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78" returned: 0 in 0.386s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-69663bb5-b772-4a8f-bc41-c9bf7919f752 tempest-VolumeDependencyTests-1734005399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:39 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78 Nov 03 07:44:39 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:39 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-69663bb5-b772-4a8f-bc41-c9bf7919f752 tempest-VolumeDependencyTests-1734005399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d6aa2a85-7449-446b-a26c-d147306a7d78" returned: 0 in 0.272s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:39 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-69663bb5-b772-4a8f-bc41-c9bf7919f752 tempest-VolumeDependencyTests-1734005399 None] Lock "cinder-quobyte-d6aa2a85-7449-446b-a26c-d147306a7d78" released by "delete_volume" :: held 0.718s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:39 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-69663bb5-b772-4a8f-bc41-c9bf7919f752 tempest-VolumeDependencyTests-1734005399 None] Created reservations ['cdea9696-edfd-4818-b43a-382fb0b053a1', '6146a154-6cb2-40ba-9de9-155b5efa7071', '2ffb438d-b601-4aac-9dc3-167ce2c7f9d6', '753acb4d-e0f8-4e1a-8f18-b9d0b97d5a28'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-69663bb5-b772-4a8f-bc41-c9bf7919f752 tempest-VolumeDependencyTests-1734005399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-69663bb5-b772-4a8f-bc41-c9bf7919f752 tempest-VolumeDependencyTests-1734005399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-69663bb5-b772-4a8f-bc41-c9bf7919f752 tempest-VolumeDependencyTests-1734005399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-69663bb5-b772-4a8f-bc41-c9bf7919f752 tempest-VolumeDependencyTests-1734005399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-69663bb5-b772-4a8f-bc41-c9bf7919f752 tempest-VolumeDependencyTests-1734005399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-69663bb5-b772-4a8f-bc41-c9bf7919f752 tempest-VolumeDependencyTests-1734005399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:39 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:44:39 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:39 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:39 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-142690c7-161b-403f-b17c-95871e012a9e tempest-VolumeDependencyTests-1734005399 None] Acquiring lock "cinder-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-69663bb5-b772-4a8f-bc41-c9bf7919f752 tempest-VolumeDependencyTests-1734005399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.277s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:39 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-69663bb5-b772-4a8f-bc41-c9bf7919f752 tempest-VolumeDependencyTests-1734005399 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:39 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-69663bb5-b772-4a8f-bc41-c9bf7919f752 tempest-VolumeDependencyTests-1734005399 None] Deleted volume successfully. Nov 03 07:44:39 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-142690c7-161b-403f-b17c-95871e012a9e tempest-VolumeDependencyTests-1734005399 None] Lock "cinder-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:40 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-69663bb5-b772-4a8f-bc41-c9bf7919f752 tempest-VolumeDependencyTests-1734005399 None] Lock "cinder-d6aa2a85-7449-446b-a26c-d147306a7d78-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:40 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-142690c7-161b-403f-b17c-95871e012a9e tempest-VolumeDependencyTests-1734005399 None] Acquiring lock "cinder-quobyte-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:40 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-142690c7-161b-403f-b17c-95871e012a9e tempest-VolumeDependencyTests-1734005399 None] Lock "cinder-quobyte-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5" acquired by "delete_volume" :: waited 0.014s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:40 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd3dd39-2b35-4774-9c76-9de8e66f39e1]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-142690c7-161b-403f-b17c-95871e012a9e tempest-VolumeDependencyTests-1734005399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:40 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5 Nov 03 07:44:40 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:40 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-142690c7-161b-403f-b17c-95871e012a9e tempest-VolumeDependencyTests-1734005399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5" returned: 0 in 0.378s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-142690c7-161b-403f-b17c-95871e012a9e tempest-VolumeDependencyTests-1734005399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:40 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5 Nov 03 07:44:40 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:40 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-142690c7-161b-403f-b17c-95871e012a9e tempest-VolumeDependencyTests-1734005399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5" returned: 0 in 0.253s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:40 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-142690c7-161b-403f-b17c-95871e012a9e tempest-VolumeDependencyTests-1734005399 None] Lock "cinder-quobyte-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5" released by "delete_volume" :: held 0.672s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:40 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-142690c7-161b-403f-b17c-95871e012a9e tempest-VolumeDependencyTests-1734005399 None] Created reservations ['050f25d0-3a53-4f2b-9946-c952ecbf95c4', 'c9a52674-80db-488c-8d1a-ae7a73e9b1fb', 'ff501853-6fa1-4465-846c-8ffeb423d700', '7d3324bb-f574-4fe2-acf3-3d864e2ec0ca'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-142690c7-161b-403f-b17c-95871e012a9e tempest-VolumeDependencyTests-1734005399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-142690c7-161b-403f-b17c-95871e012a9e tempest-VolumeDependencyTests-1734005399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-142690c7-161b-403f-b17c-95871e012a9e tempest-VolumeDependencyTests-1734005399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-142690c7-161b-403f-b17c-95871e012a9e tempest-VolumeDependencyTests-1734005399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-142690c7-161b-403f-b17c-95871e012a9e tempest-VolumeDependencyTests-1734005399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-142690c7-161b-403f-b17c-95871e012a9e tempest-VolumeDependencyTests-1734005399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:40 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:44:40 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:41 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-142690c7-161b-403f-b17c-95871e012a9e tempest-VolumeDependencyTests-1734005399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.250s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:41 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-142690c7-161b-403f-b17c-95871e012a9e tempest-VolumeDependencyTests-1734005399 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:41 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-142690c7-161b-403f-b17c-95871e012a9e tempest-VolumeDependencyTests-1734005399 None] Deleted volume successfully. Nov 03 07:44:41 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-142690c7-161b-403f-b17c-95871e012a9e tempest-VolumeDependencyTests-1734005399 None] Lock "cinder-93bd7be0-f6ba-4cc9-a42f-26ad3cb935c5-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:44 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Flow 'volume_create_manager' (c6a7e8a7-9da3-406e-b110-6509e43fb601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e172794-020d-4714-ba76-a6f2a7c661c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e172794-020d-4714-ba76-a6f2a7c661c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-821156895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6251442d-35ad-4924-a73f-cdd01a295450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c193550f97d44616b80c15818cc88b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:45Z,use_quota=True,user_id='08fbd6b070ea40eeb21b79fe3fe2bed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f4c612-e79d-4e92-9b12-02efa6ab7453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f4c612-e79d-4e92-9b12-02efa6ab7453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf1625f-5105-47c7-8288-c0e9c677851f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf1625f-5105-47c7-8288-c0e9c677851f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6251442d-35ad-4924-a73f-cdd01a295450', 'volume_name': 'volume-6251442d-35ad-4924-a73f-cdd01a295450', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d69f58f-742c-4bd4-ae9e-24cbc8c0f3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d69f58f-742c-4bd4-ae9e-24cbc8c0f3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298c82ba-0e60-4164-80fc-8b879ad6de8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:44 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Volume 6251442d-35ad-4924-a73f-cdd01a295450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6251442d-35ad-4924-a73f-cdd01a295450', 'volume_size': 1} Nov 03 07:44:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-821156895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6251442d-35ad-4924-a73f-cdd01a295450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c193550f97d44616b80c15818cc88b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:45Z,use_quota=True,user_id='08fbd6b070ea40eeb21b79fe3fe2bed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:44:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Creating volume 6251442d-35ad-4924-a73f-cdd01a295450 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:44:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:44 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:44:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6251442d-35ad-4924-a73f-cdd01a295450 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:44 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6251442d-35ad-4924-a73f-cdd01a295450 1073741824 Nov 03 07:44:44 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:45 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6251442d-35ad-4924-a73f-cdd01a295450 1073741824" returned: 0 in 0.466s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6251442d-35ad-4924-a73f-cdd01a295450 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:45 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6251442d-35ad-4924-a73f-cdd01a295450 Nov 03 07:44:45 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:45 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6251442d-35ad-4924-a73f-cdd01a295450" returned: 0 in 0.243s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:45 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:44:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298c82ba-0e60-4164-80fc-8b879ad6de8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6251442d-35ad-4924-a73f-cdd01a295450', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f3020c-3352-4eb0-b81f-85bb06f782e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:45 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Volume volume-6251442d-35ad-4924-a73f-cdd01a295450 (6251442d-35ad-4924-a73f-cdd01a295450): created successfully Nov 03 07:44:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f3020c-3352-4eb0-b81f-85bb06f782e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:45 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Flow 'volume_create_manager' (c6a7e8a7-9da3-406e-b110-6509e43fb601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:45 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-08cfe198-578f-461c-9283-9728c85c687e tempest-ProjectReaderTests-1989985483 None] Created volume successfully. Nov 03 07:44:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2cc7a868-704f-4183-a1b5-ec00ad6528b6 tempest-ProjectReaderTests-1989985483 None] Acquiring lock "cinder-6251442d-35ad-4924-a73f-cdd01a295450-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2cc7a868-704f-4183-a1b5-ec00ad6528b6 tempest-ProjectReaderTests-1989985483 None] Lock "cinder-6251442d-35ad-4924-a73f-cdd01a295450-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2cc7a868-704f-4183-a1b5-ec00ad6528b6 tempest-ProjectReaderTests-1989985483 None] Acquiring lock "cinder-quobyte-6251442d-35ad-4924-a73f-cdd01a295450" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2cc7a868-704f-4183-a1b5-ec00ad6528b6 tempest-ProjectReaderTests-1989985483 None] Lock "cinder-quobyte-6251442d-35ad-4924-a73f-cdd01a295450" acquired by "delete_volume" :: waited 0.014s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:45 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83c7639-00cb-4b43-a1a8-102e1b947de7]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2cc7a868-704f-4183-a1b5-ec00ad6528b6 tempest-ProjectReaderTests-1989985483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6251442d-35ad-4924-a73f-cdd01a295450 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:46 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6251442d-35ad-4924-a73f-cdd01a295450 Nov 03 07:44:46 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:46 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2cc7a868-704f-4183-a1b5-ec00ad6528b6 tempest-ProjectReaderTests-1989985483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6251442d-35ad-4924-a73f-cdd01a295450" returned: 0 in 0.367s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2cc7a868-704f-4183-a1b5-ec00ad6528b6 tempest-ProjectReaderTests-1989985483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6251442d-35ad-4924-a73f-cdd01a295450 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:46 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6251442d-35ad-4924-a73f-cdd01a295450 Nov 03 07:44:46 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:46 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2cc7a868-704f-4183-a1b5-ec00ad6528b6 tempest-ProjectReaderTests-1989985483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-6251442d-35ad-4924-a73f-cdd01a295450" returned: 0 in 0.252s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2cc7a868-704f-4183-a1b5-ec00ad6528b6 tempest-ProjectReaderTests-1989985483 None] Lock "cinder-quobyte-6251442d-35ad-4924-a73f-cdd01a295450" released by "delete_volume" :: held 0.657s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:46 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-2cc7a868-704f-4183-a1b5-ec00ad6528b6 tempest-ProjectReaderTests-1989985483 None] Created reservations ['e9a7208a-120c-4b07-bd6d-df2bb08bbdca', 'c844b88d-a100-4bbe-bf9c-7a12ec347868', 'b81c879d-5980-43ad-9782-18f28c2aed38', '05a24acd-527b-47b5-a64b-b9c93d7c8712'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2cc7a868-704f-4183-a1b5-ec00ad6528b6 tempest-ProjectReaderTests-1989985483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2cc7a868-704f-4183-a1b5-ec00ad6528b6 tempest-ProjectReaderTests-1989985483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2cc7a868-704f-4183-a1b5-ec00ad6528b6 tempest-ProjectReaderTests-1989985483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2cc7a868-704f-4183-a1b5-ec00ad6528b6 tempest-ProjectReaderTests-1989985483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2cc7a868-704f-4183-a1b5-ec00ad6528b6 tempest-ProjectReaderTests-1989985483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2cc7a868-704f-4183-a1b5-ec00ad6528b6 tempest-ProjectReaderTests-1989985483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:46 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:44:46 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:46 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2cc7a868-704f-4183-a1b5-ec00ad6528b6 tempest-ProjectReaderTests-1989985483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.230s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:46 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-2cc7a868-704f-4183-a1b5-ec00ad6528b6 tempest-ProjectReaderTests-1989985483 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:46 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-2cc7a868-704f-4183-a1b5-ec00ad6528b6 tempest-ProjectReaderTests-1989985483 None] Deleted volume successfully. Nov 03 07:44:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2cc7a868-704f-4183-a1b5-ec00ad6528b6 tempest-ProjectReaderTests-1989985483 None] Lock "cinder-6251442d-35ad-4924-a73f-cdd01a295450-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:47 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Flow 'volume_create_manager' (a02d5061-9c4c-4db7-96df-ec1f03f2f634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d5a80b-c831-4099-944f-7d23f1c1c8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d5a80b-c831-4099-944f-7d23f1c1c8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2130829019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837219a0-7ab1-40c4-a017-4636e6bd0037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c193550f97d44616b80c15818cc88b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:47Z,use_quota=True,user_id='08fbd6b070ea40eeb21b79fe3fe2bed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e4e9a5-fe2d-4e52-b038-0911438d5d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e4e9a5-fe2d-4e52-b038-0911438d5d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43911c95-9b68-4dde-8683-a928aa51a903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43911c95-9b68-4dde-8683-a928aa51a903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '837219a0-7ab1-40c4-a017-4636e6bd0037', 'volume_name': 'volume-837219a0-7ab1-40c4-a017-4636e6bd0037', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7599ef47-9bd7-44c0-9d3b-a1566be0c7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7599ef47-9bd7-44c0-9d3b-a1566be0c7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3a31ab-7bfe-4c8b-a694-40b0c7c0a525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:47 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Volume 837219a0-7ab1-40c4-a017-4636e6bd0037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-837219a0-7ab1-40c4-a017-4636e6bd0037', 'volume_size': 1} Nov 03 07:44:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2130829019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837219a0-7ab1-40c4-a017-4636e6bd0037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c193550f97d44616b80c15818cc88b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:47Z,use_quota=True,user_id='08fbd6b070ea40eeb21b79fe3fe2bed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:44:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Creating volume 837219a0-7ab1-40c4-a017-4636e6bd0037 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:44:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:47 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:44:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-837219a0-7ab1-40c4-a017-4636e6bd0037 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:47 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-837219a0-7ab1-40c4-a017-4636e6bd0037 1073741824 Nov 03 07:44:47 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:47 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-837219a0-7ab1-40c4-a017-4636e6bd0037 1073741824" returned: 0 in 0.420s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-837219a0-7ab1-40c4-a017-4636e6bd0037 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:48 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-837219a0-7ab1-40c4-a017-4636e6bd0037 Nov 03 07:44:48 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:48 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-837219a0-7ab1-40c4-a017-4636e6bd0037" returned: 0 in 0.238s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:44:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3a31ab-7bfe-4c8b-a694-40b0c7c0a525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-837219a0-7ab1-40c4-a017-4636e6bd0037', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (589079d8-db4f-4212-a062-db92c0286caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:48 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Volume volume-837219a0-7ab1-40c4-a017-4636e6bd0037 (837219a0-7ab1-40c4-a017-4636e6bd0037): created successfully Nov 03 07:44:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (589079d8-db4f-4212-a062-db92c0286caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Flow 'volume_create_manager' (a02d5061-9c4c-4db7-96df-ec1f03f2f634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:48 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-f61f4dca-f388-453b-b133-15888ebbe7e3 tempest-ProjectReaderTests-1989985483 None] Created volume successfully. Nov 03 07:44:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-61d00ab7-2ccf-4a2f-bdc0-a69b7ff2b83e tempest-ProjectReaderTests-1989985483 None] Acquiring lock "cinder-837219a0-7ab1-40c4-a017-4636e6bd0037-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-61d00ab7-2ccf-4a2f-bdc0-a69b7ff2b83e tempest-ProjectReaderTests-1989985483 None] Lock "cinder-837219a0-7ab1-40c4-a017-4636e6bd0037-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-61d00ab7-2ccf-4a2f-bdc0-a69b7ff2b83e tempest-ProjectReaderTests-1989985483 None] Acquiring lock "cinder-quobyte-837219a0-7ab1-40c4-a017-4636e6bd0037" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-61d00ab7-2ccf-4a2f-bdc0-a69b7ff2b83e tempest-ProjectReaderTests-1989985483 None] Lock "cinder-quobyte-837219a0-7ab1-40c4-a017-4636e6bd0037" acquired by "delete_volume" :: waited 0.016s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:48 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd299c42-6ff0-4701-8647-587e41adc845]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-61d00ab7-2ccf-4a2f-bdc0-a69b7ff2b83e tempest-ProjectReaderTests-1989985483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-837219a0-7ab1-40c4-a017-4636e6bd0037 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:48 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-837219a0-7ab1-40c4-a017-4636e6bd0037 Nov 03 07:44:48 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:48 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-61d00ab7-2ccf-4a2f-bdc0-a69b7ff2b83e tempest-ProjectReaderTests-1989985483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-837219a0-7ab1-40c4-a017-4636e6bd0037" returned: 0 in 0.339s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-61d00ab7-2ccf-4a2f-bdc0-a69b7ff2b83e tempest-ProjectReaderTests-1989985483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-837219a0-7ab1-40c4-a017-4636e6bd0037 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:48 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-837219a0-7ab1-40c4-a017-4636e6bd0037 Nov 03 07:44:48 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:49 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-61d00ab7-2ccf-4a2f-bdc0-a69b7ff2b83e tempest-ProjectReaderTests-1989985483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-837219a0-7ab1-40c4-a017-4636e6bd0037" returned: 0 in 0.249s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:49 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:44:49 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-61d00ab7-2ccf-4a2f-bdc0-a69b7ff2b83e tempest-ProjectReaderTests-1989985483 None] Lock "cinder-quobyte-837219a0-7ab1-40c4-a017-4636e6bd0037" released by "delete_volume" :: held 0.634s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-61d00ab7-2ccf-4a2f-bdc0-a69b7ff2b83e tempest-ProjectReaderTests-1989985483 None] Created reservations ['60eac529-66ec-47b8-b299-5d56d165d278', '0543181d-1d2d-452c-b2bb-0d392381ced8', 'b15ccf91-f823-4a27-ad80-4adb5e7211f7', '2bfe20dc-7b0e-42b7-9d0e-826be720398b'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-61d00ab7-2ccf-4a2f-bdc0-a69b7ff2b83e tempest-ProjectReaderTests-1989985483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-61d00ab7-2ccf-4a2f-bdc0-a69b7ff2b83e tempest-ProjectReaderTests-1989985483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-61d00ab7-2ccf-4a2f-bdc0-a69b7ff2b83e tempest-ProjectReaderTests-1989985483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-61d00ab7-2ccf-4a2f-bdc0-a69b7ff2b83e tempest-ProjectReaderTests-1989985483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-61d00ab7-2ccf-4a2f-bdc0-a69b7ff2b83e tempest-ProjectReaderTests-1989985483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-61d00ab7-2ccf-4a2f-bdc0-a69b7ff2b83e tempest-ProjectReaderTests-1989985483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:49 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:44:49 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:49 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.276s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 28 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:44:49 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-61d00ab7-2ccf-4a2f-bdc0-a69b7ff2b83e tempest-ProjectReaderTests-1989985483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.240s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-61d00ab7-2ccf-4a2f-bdc0-a69b7ff2b83e tempest-ProjectReaderTests-1989985483 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:49 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-61d00ab7-2ccf-4a2f-bdc0-a69b7ff2b83e tempest-ProjectReaderTests-1989985483 None] Deleted volume successfully. Nov 03 07:44:49 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-61d00ab7-2ccf-4a2f-bdc0-a69b7ff2b83e tempest-ProjectReaderTests-1989985483 None] Lock "cinder-837219a0-7ab1-40c4-a017-4636e6bd0037-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:59 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:UPDATE=66,cinder:SELECT=46,cinder:INSERT=19,cinder:DELETE=4 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:44:59 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=58,cinder:INSERT=21,cinder:UPDATE=62,cinder:DELETE=7 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:45:06 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Flow 'volume_create_manager' (e9625fd5-144f-43e8-a8c8-721d6bd6fbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd45860-e124-48d1-8142-80515e19e572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd45860-e124-48d1-8142-80515e19e572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa762b9f-2645-49c4-a074-8ca76d1b8867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89d5e2d18ca24237b50b7d243978d8b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:07Z,use_quota=True,user_id='cfa2a44b633c46a6a25d2d8298a38db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4402e4-8420-419e-9a48-f24e6e3fc3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4402e4-8420-419e-9a48-f24e6e3fc3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b79970-1aa1-4695-b6e1-009eb1765e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b79970-1aa1-4695-b6e1-009eb1765e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa762b9f-2645-49c4-a074-8ca76d1b8867', 'volume_name': 'volume-fa762b9f-2645-49c4-a074-8ca76d1b8867', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (189155b6-f9af-4e57-bfc2-81c922ea4e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (189155b6-f9af-4e57-bfc2-81c922ea4e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (156f16e2-7832-48ba-bd0e-864a08d7f40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:06 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Volume fa762b9f-2645-49c4-a074-8ca76d1b8867: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa762b9f-2645-49c4-a074-8ca76d1b8867', 'volume_size': 1} Nov 03 07:45:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:06 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa762b9f-2645-49c4-a074-8ca76d1b8867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89d5e2d18ca24237b50b7d243978d8b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:07Z,use_quota=True,user_id='cfa2a44b633c46a6a25d2d8298a38db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:45:06 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Creating volume fa762b9f-2645-49c4-a074-8ca76d1b8867 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:06 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:06 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:06 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:06 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:45:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa762b9f-2645-49c4-a074-8ca76d1b8867 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:06 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:06 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa762b9f-2645-49c4-a074-8ca76d1b8867 1073741824 Nov 03 07:45:06 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Flow 'volume_create_manager' (c5ef68bc-eb31-42b1-abd0-09e9c61f3be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c26317-34fd-4f9d-ab36-25efadd9582f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c26317-34fd-4f9d-ab36-25efadd9582f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1182588139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16132860-d045-46c0-b290-95bfc1dc9008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6cc0cd0cba34a598d4386be78768c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:07Z,use_quota=True,user_id='2de3be63a5ba4e57b0b47365ad6cf7c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d73359-03fa-49cd-b9ba-bb21e204d111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d73359-03fa-49cd-b9ba-bb21e204d111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e86ed6-8235-43b3-a84e-5db03a1a3ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e86ed6-8235-43b3-a84e-5db03a1a3ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16132860-d045-46c0-b290-95bfc1dc9008', 'volume_name': 'volume-16132860-d045-46c0-b290-95bfc1dc9008', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee52634-4fb7-4e26-9449-a619872489d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee52634-4fb7-4e26-9449-a619872489d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98cb2dd4-58bb-4ef4-9912-1127c5b8e546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:07 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Volume 16132860-d045-46c0-b290-95bfc1dc9008: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16132860-d045-46c0-b290-95bfc1dc9008', 'volume_size': 1} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Flow 'volume_create_manager' (706f9af0-1c96-42f1-b002-81bb70719a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3d0c2f-eb52-4699-a1da-e87a4feefb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3d0c2f-eb52-4699-a1da-e87a4feefb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-609554451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f594b77-d5e4-4816-96b4-1ca89b625710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6cc0cd0cba34a598d4386be78768c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:07Z,use_quota=True,user_id='2de3be63a5ba4e57b0b47365ad6cf7c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ea450e-468e-44b1-ab59-6a0c2cdb601a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ea450e-468e-44b1-ab59-6a0c2cdb601a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (456d9c33-3581-4025-87e9-2ea1cb068e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (456d9c33-3581-4025-87e9-2ea1cb068e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f594b77-d5e4-4816-96b4-1ca89b625710', 'volume_name': 'volume-0f594b77-d5e4-4816-96b4-1ca89b625710', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a78bc21-4083-48c1-bc17-de07f8d931be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a78bc21-4083-48c1-bc17-de07f8d931be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b3beea1-816f-4622-8b27-1e019fcac28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:07 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Volume 0f594b77-d5e4-4816-96b4-1ca89b625710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f594b77-d5e4-4816-96b4-1ca89b625710', 'volume_size': 1} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Flow 'volume_create_manager' (8eaf8572-b975-4e23-8bb6-83184ea3d16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e81c21c-a8b8-4b31-8438-4d3a401916fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e81c21c-a8b8-4b31-8438-4d3a401916fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1748356695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f3586f6-4ff0-48d0-be45-5f5083106bbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99934a2f2ab548ce9f5f2ba8a49cf709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:08Z,use_quota=True,user_id='5a9ebe81a063481fb2208df2d7aade5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c130c78-9e98-4855-8098-4df58d4d901a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c130c78-9e98-4855-8098-4df58d4d901a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99be800d-2281-4b08-8d79-ec160185cfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99be800d-2281-4b08-8d79-ec160185cfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f3586f6-4ff0-48d0-be45-5f5083106bbf', 'volume_name': 'volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda72e37-a84d-4088-8bdd-0f060aed0e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda72e37-a84d-4088-8bdd-0f060aed0e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335cc497-1066-4707-b6f3-9c046fa68d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:07 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Volume 0f3586f6-4ff0-48d0-be45-5f5083106bbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf', 'volume_size': 1} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:07 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa762b9f-2645-49c4-a074-8ca76d1b8867 1073741824" returned: 0 in 0.925s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa762b9f-2645-49c4-a074-8ca76d1b8867 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:07 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa762b9f-2645-49c4-a074-8ca76d1b8867 Nov 03 07:45:07 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:07 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Flow 'volume_create_manager' (c7fdf290-fae1-4bd3-b99b-585e0ea79a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8afe5d-5157-43f6-8336-790b161ca5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8afe5d-5157-43f6-8336-790b161ca5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-139070897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b713790-1e75-42b3-b579-bd7e33aa1155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6cc0cd0cba34a598d4386be78768c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:08Z,use_quota=True,user_id='2de3be63a5ba4e57b0b47365ad6cf7c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a41899-cf11-45a5-9b80-4318a0ee423b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a41899-cf11-45a5-9b80-4318a0ee423b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf9e77f-6f2b-4a8a-b527-0183ce8db696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf9e77f-6f2b-4a8a-b527-0183ce8db696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b713790-1e75-42b3-b579-bd7e33aa1155', 'volume_name': 'volume-7b713790-1e75-42b3-b579-bd7e33aa1155', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261b96bc-a552-4eba-a5e7-0b36e56c2694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261b96bc-a552-4eba-a5e7-0b36e56c2694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca02ba2c-d316-4fce-8bb0-b18971f5b21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:08 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Volume 7b713790-1e75-42b3-b579-bd7e33aa1155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b713790-1e75-42b3-b579-bd7e33aa1155', 'volume_size': 1} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:08 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa762b9f-2645-49c4-a074-8ca76d1b8867" returned: 0 in 0.414s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.233s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1182588139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16132860-d045-46c0-b290-95bfc1dc9008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6cc0cd0cba34a598d4386be78768c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:07Z,use_quota=True,user_id='2de3be63a5ba4e57b0b47365ad6cf7c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Creating volume 16132860-d045-46c0-b290-95bfc1dc9008 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:08 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-16132860-d045-46c0-b290-95bfc1dc9008 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (156f16e2-7832-48ba-bd0e-864a08d7f40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa762b9f-2645-49c4-a074-8ca76d1b8867', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb4274b6-bc18-4966-b3e5-d7ab8d115d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:08 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-16132860-d045-46c0-b290-95bfc1dc9008 1073741824 Nov 03 07:45:08 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:08 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Volume volume-fa762b9f-2645-49c4-a074-8ca76d1b8867 (fa762b9f-2645-49c4-a074-8ca76d1b8867): created successfully Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb4274b6-bc18-4966-b3e5-d7ab8d115d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Flow 'volume_create_manager' (e9625fd5-144f-43e8-a8c8-721d6bd6fbb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:08 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-7342bc07-64e6-4949-b85e-7153a6258c6d tempest-CinderUnicodeTest-1868854618 None] Created volume successfully. Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Flow 'volume_create_manager' (422df2f8-1703-423d-9e9b-590f9a992ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d519fc-c5fb-48b8-bc29-a36bc0331c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d519fc-c5fb-48b8-bc29-a36bc0331c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1208931736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a80cad5-0b00-48cb-8392-fd9a1282c504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6cc0cd0cba34a598d4386be78768c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:08Z,use_quota=True,user_id='2de3be63a5ba4e57b0b47365ad6cf7c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc32cfc2-6540-448c-9713-72a434b8dd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc32cfc2-6540-448c-9713-72a434b8dd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e72cf44-3707-4ab8-9381-526f2f23bf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e72cf44-3707-4ab8-9381-526f2f23bf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a80cad5-0b00-48cb-8392-fd9a1282c504', 'volume_name': 'volume-1a80cad5-0b00-48cb-8392-fd9a1282c504', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4307444-205f-413a-a8c5-97c291090992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4307444-205f-413a-a8c5-97c291090992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a20aef1-976b-4640-8e45-f8a0c6cb095c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:08 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Volume 1a80cad5-0b00-48cb-8392-fd9a1282c504: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a80cad5-0b00-48cb-8392-fd9a1282c504', 'volume_size': 1} Nov 03 07:45:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:09 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-16132860-d045-46c0-b290-95bfc1dc9008 1073741824" returned: 0 in 0.760s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Flow 'volume_create_manager' (6a0753bd-778c-4ae2-a64d-db62d7079dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e382a910-26f2-4bd5-a719-153331e722cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e382a910-26f2-4bd5-a719-153331e722cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1556319732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97361a4f-01a3-44ef-b2b3-85b73970aefc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6cc0cd0cba34a598d4386be78768c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:09Z,use_quota=True,user_id='2de3be63a5ba4e57b0b47365ad6cf7c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f86a6a0c-dcdd-4612-b629-7b2262b4da2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f86a6a0c-dcdd-4612-b629-7b2262b4da2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3f3f53-65db-4457-9f30-81f30c5a2f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3f3f53-65db-4457-9f30-81f30c5a2f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97361a4f-01a3-44ef-b2b3-85b73970aefc', 'volume_name': 'volume-97361a4f-01a3-44ef-b2b3-85b73970aefc', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (babaeaa5-06e4-4af9-af54-6651219cc9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (babaeaa5-06e4-4af9-af54-6651219cc9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522db0dd-9cef-43ed-ae8d-5357ac52997d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:09 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Volume 97361a4f-01a3-44ef-b2b3-85b73970aefc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97361a4f-01a3-44ef-b2b3-85b73970aefc', 'volume_size': 1} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-16132860-d045-46c0-b290-95bfc1dc9008 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:09 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-16132860-d045-46c0-b290-95bfc1dc9008 Nov 03 07:45:09 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:09 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-16132860-d045-46c0-b290-95bfc1dc9008" returned: 0 in 0.286s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.857s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-609554451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f594b77-d5e4-4816-96b4-1ca89b625710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6cc0cd0cba34a598d4386be78768c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:07Z,use_quota=True,user_id='2de3be63a5ba4e57b0b47365ad6cf7c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Creating volume 0f594b77-d5e4-4816-96b4-1ca89b625710 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:09 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f594b77-d5e4-4816-96b4-1ca89b625710 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:09 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f594b77-d5e4-4816-96b4-1ca89b625710 1073741824 Nov 03 07:45:09 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98cb2dd4-58bb-4ef4-9912-1127c5b8e546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16132860-d045-46c0-b290-95bfc1dc9008', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d395e646-edcb-4067-937e-ca5c37834953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:09 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Volume volume-16132860-d045-46c0-b290-95bfc1dc9008 (16132860-d045-46c0-b290-95bfc1dc9008): created successfully Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d395e646-edcb-4067-937e-ca5c37834953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Flow 'volume_create_manager' (c5ef68bc-eb31-42b1-abd0-09e9c61f3be5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Flow 'volume_create_manager' (18ca335d-291b-48d5-89bb-466ea37b58e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92234ea-d7c7-45c3-87b6-0a33b7ae6dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:09 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-5d100d8e-5594-41cd-b161-d228fffa3e8a tempest-CreateVolumesFromImageTest-856100807 None] Created volume successfully. Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92234ea-d7c7-45c3-87b6-0a33b7ae6dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1320245516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0206ecc2-ec51-4d24-b19a-578a71ebe521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89d5e2d18ca24237b50b7d243978d8b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:10Z,use_quota=True,user_id='cfa2a44b633c46a6a25d2d8298a38db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc233fa-5c1b-4eef-acf2-2985aa2e47ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc233fa-5c1b-4eef-acf2-2985aa2e47ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39624799-0998-440f-8b89-5bf4cff8abbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39624799-0998-440f-8b89-5bf4cff8abbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0206ecc2-ec51-4d24-b19a-578a71ebe521', 'volume_name': 'volume-0206ecc2-ec51-4d24-b19a-578a71ebe521', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045c0e90-04a1-470a-bc17-d8094aa43e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045c0e90-04a1-470a-bc17-d8094aa43e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7ca556-cb28-4384-8334-6a348e528803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:09 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Volume 0206ecc2-ec51-4d24-b19a-578a71ebe521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0206ecc2-ec51-4d24-b19a-578a71ebe521', 'volume_size': 1} Nov 03 07:45:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:10 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f594b77-d5e4-4816-96b4-1ca89b625710 1073741824" returned: 0 in 0.554s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f594b77-d5e4-4816-96b4-1ca89b625710 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:10 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f594b77-d5e4-4816-96b4-1ca89b625710 Nov 03 07:45:10 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:10 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f594b77-d5e4-4816-96b4-1ca89b625710" returned: 0 in 0.302s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:45:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.630s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1748356695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f3586f6-4ff0-48d0-be45-5f5083106bbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99934a2f2ab548ce9f5f2ba8a49cf709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:08Z,use_quota=True,user_id='5a9ebe81a063481fb2208df2d7aade5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:45:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Creating volume 0f3586f6-4ff0-48d0-be45-5f5083106bbf {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:10 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:45:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b3beea1-816f-4622-8b27-1e019fcac28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f594b77-d5e4-4816-96b4-1ca89b625710', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be741a4-bcfd-4f41-a7f8-48482f450287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:10 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf 1073741824 Nov 03 07:45:10 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:10 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Volume volume-0f594b77-d5e4-4816-96b4-1ca89b625710 (0f594b77-d5e4-4816-96b4-1ca89b625710): created successfully Nov 03 07:45:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be741a4-bcfd-4f41-a7f8-48482f450287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:10 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Flow 'volume_create_manager' (706f9af0-1c96-42f1-b002-81bb70719a66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:10 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-8ec40780-4416-43da-9996-b0c46a4f00bc tempest-CreateVolumesFromImageTest-856100807 None] Created volume successfully. Nov 03 07:45:10 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf 1073741824" returned: 0 in 0.502s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:11 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf Nov 03 07:45:11 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:11 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf" returned: 0 in 0.279s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.157s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-139070897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b713790-1e75-42b3-b579-bd7e33aa1155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6cc0cd0cba34a598d4386be78768c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:08Z,use_quota=True,user_id='2de3be63a5ba4e57b0b47365ad6cf7c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Creating volume 7b713790-1e75-42b3-b579-bd7e33aa1155 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:11 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b713790-1e75-42b3-b579-bd7e33aa1155 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335cc497-1066-4707-b6f3-9c046fa68d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b8ac44c-4f83-48bd-bb28-2b435b7b0545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:11 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b713790-1e75-42b3-b579-bd7e33aa1155 1073741824 Nov 03 07:45:11 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:11 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Volume volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf (0f3586f6-4ff0-48d0-be45-5f5083106bbf): created successfully Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b8ac44c-4f83-48bd-bb28-2b435b7b0545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Flow 'volume_create_manager' (8eaf8572-b975-4e23-8bb6-83184ea3d16d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:11 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-49e4d98f-cf0b-4889-b8a8-d6cc1a547e4c tempest-VolumeDependencyTests-1557140602 None] Created volume successfully. Nov 03 07:45:11 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b713790-1e75-42b3-b579-bd7e33aa1155 1073741824" returned: 0 in 0.526s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Flow 'volume_create_manager' (ff50f54c-a931-4302-88aa-e9fc02bdb982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5637ed5a-aab0-4c67-9bc6-3bdbc0f0b4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b713790-1e75-42b3-b579-bd7e33aa1155 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5637ed5a-aab0-4c67-9bc6-3bdbc0f0b4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f80440f1-e641-4700-8aff-17420ce83664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f74a9ef58c43c7b2e7d69b197028eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:12Z,use_quota=True,user_id='9096860427274f24b6a89432040dc10d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcd0c4d1-05a5-4618-88fd-bcf255052a1e),volume_type_id=fcd0c4d1-05a5-4618-88fd-bcf255052a1e)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b58ebd-f14e-4d0e-bffb-cc80ddb7329e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:11 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b713790-1e75-42b3-b579-bd7e33aa1155 Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b58ebd-f14e-4d0e-bffb-cc80ddb7329e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:11 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0af249-0bf5-4350-825d-b6b5503179a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:11 devstack cinder-volume[87016]: DEBUG cinder.image.glance [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Creating Keystone auth plugin from conf {{(pid=87016) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:45:12 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b713790-1e75-42b3-b579-bd7e33aa1155" returned: 0 in 0.324s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.564s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1208931736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a80cad5-0b00-48cb-8392-fd9a1282c504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6cc0cd0cba34a598d4386be78768c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:08Z,use_quota=True,user_id='2de3be63a5ba4e57b0b47365ad6cf7c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Creating volume 1a80cad5-0b00-48cb-8392-fd9a1282c504 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:12 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a80cad5-0b00-48cb-8392-fd9a1282c504 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0af249-0bf5-4350-825d-b6b5503179a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f80440f1-e641-4700-8aff-17420ce83664', 'volume_name': 'volume-f80440f1-e641-4700-8aff-17420ce83664', 'volume_size': 1, 'image_id': 'c4f4c0b2-63f4-438a-9ade-ef23b353209c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4f4c0b2-63f4-438a-9ade-ef23b353209c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1e5d89836f30bee87a3df7a1ab8fc64c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '06f74a9ef58c43c7b2e7d69b197028eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '095e81c31010c0f10e3843c7ff115f7a9b6eb170b3f4df4904fe3514f62db0c432b2e8114daf8c8f0b421bfc8cfc6338c327f2039b8c52fed63028a3934c5464', 'id': 'c4f4c0b2-63f4-438a-9ade-ef23b353209c', 'created_at': datetime.datetime(2026, 11, 3, 6, 45, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 45, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4f4c0b2-63f4-438a-9ade-ef23b353209c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecdf8042-f336-484d-86b6-7ac21b1ab1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:12 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a80cad5-0b00-48cb-8392-fd9a1282c504 1073741824 Nov 03 07:45:12 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecdf8042-f336-484d-86b6-7ac21b1ab1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89ad8e93-3d7f-4819-90d9-40827e546bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:12 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Volume f80440f1-e641-4700-8aff-17420ce83664: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f80440f1-e641-4700-8aff-17420ce83664', 'volume_size': 1, 'image_id': 'c4f4c0b2-63f4-438a-9ade-ef23b353209c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4f4c0b2-63f4-438a-9ade-ef23b353209c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1e5d89836f30bee87a3df7a1ab8fc64c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '06f74a9ef58c43c7b2e7d69b197028eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '095e81c31010c0f10e3843c7ff115f7a9b6eb170b3f4df4904fe3514f62db0c432b2e8114daf8c8f0b421bfc8cfc6338c327f2039b8c52fed63028a3934c5464', 'id': 'c4f4c0b2-63f4-438a-9ade-ef23b353209c', 'created_at': datetime.datetime(2026, 11, 3, 6, 45, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 45, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4f4c0b2-63f4-438a-9ade-ef23b353209c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Trying to clone f80440f1-e641-4700-8aff-17420ce83664 from image c4f4c0b2-63f4-438a-9ade-ef23b353209c at location (None, [{'url': 'file:///opt/stack/data/glance/images/c4f4c0b2-63f4-438a-9ade-ef23b353209c', 'metadata': {}}]). {{(pid=87016) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca02ba2c-d316-4fce-8bb0-b18971f5b21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b713790-1e75-42b3-b579-bd7e33aa1155', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa5ef14-53cb-475d-9639-8d3dc3eb761c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:12 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Volume volume-7b713790-1e75-42b3-b579-bd7e33aa1155 (7b713790-1e75-42b3-b579-bd7e33aa1155): created successfully Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa5ef14-53cb-475d-9639-8d3dc3eb761c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Flow 'volume_create_manager' (c7fdf290-fae1-4bd3-b99b-585e0ea79a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b8437d9b-d98f-4d69-8ce6-5be5e40de2cb tempest-VolumeDependencyTests-1557140602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:12 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-2a0919e0-ad7a-4faa-992f-e343d99d6b72 tempest-CreateVolumesFromImageTest-856100807 None] Created volume successfully. Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:45:12 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Image download 0.00 MB at 0.00 MB/s Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c142af-fb4b-481b-a25f-2eefa0e687d1]: (4, 'raw') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:12 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD Nov 03 07:45:12 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:12 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a80cad5-0b00-48cb-8392-fd9a1282c504 1073741824" returned: 0 in 0.461s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a80cad5-0b00-48cb-8392-fd9a1282c504 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:12 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a80cad5-0b00-48cb-8392-fd9a1282c504 Nov 03 07:45:12 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:12 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:12 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD Nov 03 07:45:12 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:13 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a80cad5-0b00-48cb-8392-fd9a1282c504" returned: 0 in 0.268s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.795s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1556319732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97361a4f-01a3-44ef-b2b3-85b73970aefc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6cc0cd0cba34a598d4386be78768c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:09Z,use_quota=True,user_id='2de3be63a5ba4e57b0b47365ad6cf7c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Creating volume 97361a4f-01a3-44ef-b2b3-85b73970aefc {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:13 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-97361a4f-01a3-44ef-b2b3-85b73970aefc 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a20aef1-976b-4640-8e45-f8a0c6cb095c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a80cad5-0b00-48cb-8392-fd9a1282c504', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:13 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-97361a4f-01a3-44ef-b2b3-85b73970aefc 1073741824 Nov 03 07:45:13 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b147d9-f58d-4308-bfd5-38b1ffe51e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:13 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Volume volume-1a80cad5-0b00-48cb-8392-fd9a1282c504 (1a80cad5-0b00-48cb-8392-fd9a1282c504): created successfully Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b147d9-f58d-4308-bfd5-38b1ffe51e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Flow 'volume_create_manager' (422df2f8-1703-423d-9e9b-590f9a992ae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:13 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-9c9768dc-ed69-46ff-9bf9-47e8abb79ed8 tempest-CreateVolumesFromImageTest-856100807 None] Created volume successfully. Nov 03 07:45:13 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD" returned: 1 in 0.366s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Temporary image c4f4c0b2-63f4-438a-9ade-ef23b353209c is fetched for user 9096860427274f24b6a89432040dc10d. {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[440638d4-943c-4eb4-b598-dc7c27c544b1]: (4, 'raw') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:13 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD Nov 03 07:45:13 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:13 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-97361a4f-01a3-44ef-b2b3-85b73970aefc 1073741824" returned: 0 in 0.494s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-97361a4f-01a3-44ef-b2b3-85b73970aefc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:13 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-97361a4f-01a3-44ef-b2b3-85b73970aefc Nov 03 07:45:13 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:13 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:13 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD Nov 03 07:45:13 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:13 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-97361a4f-01a3-44ef-b2b3-85b73970aefc" returned: 0 in 0.253s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.121s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1320245516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0206ecc2-ec51-4d24-b19a-578a71ebe521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89d5e2d18ca24237b50b7d243978d8b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:10Z,use_quota=True,user_id='cfa2a44b633c46a6a25d2d8298a38db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Creating volume 0206ecc2-ec51-4d24-b19a-578a71ebe521 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:13 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522db0dd-9cef-43ed-ae8d-5357ac52997d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97361a4f-01a3-44ef-b2b3-85b73970aefc', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:13 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521 1073741824 Nov 03 07:45:13 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e790b065-4048-4cb5-be9e-f0167d5ce830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:13 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Volume volume-97361a4f-01a3-44ef-b2b3-85b73970aefc (97361a4f-01a3-44ef-b2b3-85b73970aefc): created successfully Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e790b065-4048-4cb5-be9e-f0167d5ce830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Flow 'volume_create_manager' (6a0753bd-778c-4ae2-a64d-db62d7079dd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:13 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-fadccf7d-b08a-4527-a1c7-659cf9fc7260 tempest-CreateVolumesFromImageTest-856100807 None] Created volume successfully. Nov 03 07:45:14 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD" returned: 1 in 0.376s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:45:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:14 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521 1073741824" returned: 0 in 0.447s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:14 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521 Nov 03 07:45:14 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:14 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521" returned: 0 in 0.259s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:45:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b8437d9b-d98f-4d69-8ce6-5be5e40de2cb tempest-VolumeDependencyTests-1557140602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.235s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7ca556-cb28-4384-8334-6a348e528803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0206ecc2-ec51-4d24-b19a-578a71ebe521', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0457f4fb-386f-499b-a72b-93e642625383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-b8437d9b-d98f-4d69-8ce6-5be5e40de2cb tempest-VolumeDependencyTests-1557140602 None] Creating offline snapshot cc32c897-2b0f-41f8-9158-674a1ed47a5d of volume 0f3586f6-4ff0-48d0-be45-5f5083106bbf {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:45:14 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Volume volume-0206ecc2-ec51-4d24-b19a-578a71ebe521 (0206ecc2-ec51-4d24-b19a-578a71ebe521): created successfully Nov 03 07:45:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0457f4fb-386f-499b-a72b-93e642625383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Flow 'volume_create_manager' (18ca335d-291b-48d5-89bb-466ea37b58e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:14 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bab5b1f-8ad3-412a-a9ea-3fc0f76f5521]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d0ab5f47-b501-4866-9df1-5fdadbf8783e tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "cinder-97361a4f-01a3-44ef-b2b3-85b73970aefc-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8437d9b-d98f-4d69-8ce6-5be5e40de2cb tempest-VolumeDependencyTests-1557140602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:14 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a2961906-2fee-4b9b-9d8f-ecbec7434a92 tempest-CinderUnicodeTest-1868854618 None] Created volume successfully. Nov 03 07:45:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d0ab5f47-b501-4866-9df1-5fdadbf8783e tempest-CreateVolumesFromImageTest-856100807 None] Lock "cinder-97361a4f-01a3-44ef-b2b3-85b73970aefc-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d0ab5f47-b501-4866-9df1-5fdadbf8783e tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "cinder-quobyte-97361a4f-01a3-44ef-b2b3-85b73970aefc" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d0ab5f47-b501-4866-9df1-5fdadbf8783e tempest-CreateVolumesFromImageTest-856100807 None] Lock "cinder-quobyte-97361a4f-01a3-44ef-b2b3-85b73970aefc" acquired by "delete_volume" :: waited 0.020s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:14 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[206129d2-3fa8-44ec-b3f9-680d1a1b9358]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d0ab5f47-b501-4866-9df1-5fdadbf8783e tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-97361a4f-01a3-44ef-b2b3-85b73970aefc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:14 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf Nov 03 07:45:14 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:14 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-97361a4f-01a3-44ef-b2b3-85b73970aefc Nov 03 07:45:14 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:15 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8437d9b-d98f-4d69-8ce6-5be5e40de2cb tempest-VolumeDependencyTests-1557140602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf" returned: 0 in 0.470s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8437d9b-d98f-4d69-8ce6-5be5e40de2cb tempest-VolumeDependencyTests-1557140602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.cc32c897-2b0f-41f8-9158-674a1ed47a5d 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:15 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.cc32c897-2b0f-41f8-9158-674a1ed47a5d 1G Nov 03 07:45:15 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-671b1073-25b3-4c36-adcc-ede6037a020a tempest-CinderUnicodeTest-1868854618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:15 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d0ab5f47-b501-4866-9df1-5fdadbf8783e tempest-CreateVolumesFromImageTest-856100807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-97361a4f-01a3-44ef-b2b3-85b73970aefc" returned: 0 in 0.440s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d0ab5f47-b501-4866-9df1-5fdadbf8783e tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-97361a4f-01a3-44ef-b2b3-85b73970aefc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:15 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-97361a4f-01a3-44ef-b2b3-85b73970aefc Nov 03 07:45:15 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:15 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d0ab5f47-b501-4866-9df1-5fdadbf8783e tempest-CreateVolumesFromImageTest-856100807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-97361a4f-01a3-44ef-b2b3-85b73970aefc" returned: 0 in 0.260s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d0ab5f47-b501-4866-9df1-5fdadbf8783e tempest-CreateVolumesFromImageTest-856100807 None] Lock "cinder-quobyte-97361a4f-01a3-44ef-b2b3-85b73970aefc" released by "delete_volume" :: held 0.756s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-d0ab5f47-b501-4866-9df1-5fdadbf8783e tempest-CreateVolumesFromImageTest-856100807 None] Created reservations ['532c8810-d182-48ca-98ca-00becbae3c56', '30b8a794-f795-45e0-8f1e-a2b99b217d02', 'ceda7ec3-7211-4f37-93f7-4c94add06c6b', 'a871e9ae-1828-4bd4-9518-ff2a0828ee59'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:15 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8437d9b-d98f-4d69-8ce6-5be5e40de2cb tempest-VolumeDependencyTests-1557140602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.cc32c897-2b0f-41f8-9158-674a1ed47a5d 1G" returned: 0 in 0.444s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8437d9b-d98f-4d69-8ce6-5be5e40de2cb tempest-VolumeDependencyTests-1557140602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.cc32c897-2b0f-41f8-9158-674a1ed47a5d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:15 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.cc32c897-2b0f-41f8-9158-674a1ed47a5d Nov 03 07:45:15 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d0ab5f47-b501-4866-9df1-5fdadbf8783e tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d0ab5f47-b501-4866-9df1-5fdadbf8783e tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d0ab5f47-b501-4866-9df1-5fdadbf8783e tempest-CreateVolumesFromImageTest-856100807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d0ab5f47-b501-4866-9df1-5fdadbf8783e tempest-CreateVolumesFromImageTest-856100807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d0ab5f47-b501-4866-9df1-5fdadbf8783e tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d0ab5f47-b501-4866-9df1-5fdadbf8783e tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:15 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:45:15 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-207007ce-a799-4731-9709-d8e1461072b3 tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "cinder-1a80cad5-0b00-48cb-8392-fd9a1282c504-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-207007ce-a799-4731-9709-d8e1461072b3 tempest-CreateVolumesFromImageTest-856100807 None] Lock "cinder-1a80cad5-0b00-48cb-8392-fd9a1282c504-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-207007ce-a799-4731-9709-d8e1461072b3 tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "cinder-quobyte-1a80cad5-0b00-48cb-8392-fd9a1282c504" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:15 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d0ab5f47-b501-4866-9df1-5fdadbf8783e tempest-CreateVolumesFromImageTest-856100807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.271s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-d0ab5f47-b501-4866-9df1-5fdadbf8783e tempest-CreateVolumesFromImageTest-856100807 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:15 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:15 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-d0ab5f47-b501-4866-9df1-5fdadbf8783e tempest-CreateVolumesFromImageTest-856100807 None] Deleted volume successfully. Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-207007ce-a799-4731-9709-d8e1461072b3 tempest-CreateVolumesFromImageTest-856100807 None] Lock "cinder-quobyte-1a80cad5-0b00-48cb-8392-fd9a1282c504" acquired by "delete_volume" :: waited 0.025s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8437d9b-d98f-4d69-8ce6-5be5e40de2cb tempest-VolumeDependencyTests-1557140602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.cc32c897-2b0f-41f8-9158-674a1ed47a5d" returned: 0 in 0.383s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:15 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-b8437d9b-d98f-4d69-8ce6-5be5e40de2cb tempest-VolumeDependencyTests-1557140602 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.cc32c897-2b0f-41f8-9158-674a1ed47a5d is being set with open permissions: ugo+rw Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8437d9b-d98f-4d69-8ce6-5be5e40de2cb tempest-VolumeDependencyTests-1557140602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.cc32c897-2b0f-41f8-9158-674a1ed47a5d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:15 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ca800e-8013-4e67-b8d4-2ce09def0a08]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-207007ce-a799-4731-9709-d8e1461072b3 tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a80cad5-0b00-48cb-8392-fd9a1282c504 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:16 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.cc32c897-2b0f-41f8-9158-674a1ed47a5d Nov 03 07:45:16 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d0ab5f47-b501-4866-9df1-5fdadbf8783e tempest-CreateVolumesFromImageTest-856100807 None] Lock "cinder-97361a4f-01a3-44ef-b2b3-85b73970aefc-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:16 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a80cad5-0b00-48cb-8392-fd9a1282c504 Nov 03 07:45:16 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:16 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8437d9b-d98f-4d69-8ce6-5be5e40de2cb tempest-VolumeDependencyTests-1557140602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.cc32c897-2b0f-41f8-9158-674a1ed47a5d" returned: 0 in 0.282s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8437d9b-d98f-4d69-8ce6-5be5e40de2cb tempest-VolumeDependencyTests-1557140602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:16 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.info Nov 03 07:45:16 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:16 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-207007ce-a799-4731-9709-d8e1461072b3 tempest-CreateVolumesFromImageTest-856100807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a80cad5-0b00-48cb-8392-fd9a1282c504" returned: 0 in 0.394s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-207007ce-a799-4731-9709-d8e1461072b3 tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a80cad5-0b00-48cb-8392-fd9a1282c504 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:16 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a80cad5-0b00-48cb-8392-fd9a1282c504 Nov 03 07:45:16 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:16 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8437d9b-d98f-4d69-8ce6-5be5e40de2cb tempest-VolumeDependencyTests-1557140602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.info" returned: 0 in 0.286s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:16 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-b8437d9b-d98f-4d69-8ce6-5be5e40de2cb tempest-VolumeDependencyTests-1557140602 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.info is being set with open permissions: ugo+rw Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8437d9b-d98f-4d69-8ce6-5be5e40de2cb tempest-VolumeDependencyTests-1557140602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:16 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.info Nov 03 07:45:16 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:16 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-207007ce-a799-4731-9709-d8e1461072b3 tempest-CreateVolumesFromImageTest-856100807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1a80cad5-0b00-48cb-8392-fd9a1282c504" returned: 0 in 0.253s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-207007ce-a799-4731-9709-d8e1461072b3 tempest-CreateVolumesFromImageTest-856100807 None] Lock "cinder-quobyte-1a80cad5-0b00-48cb-8392-fd9a1282c504" released by "delete_volume" :: held 0.711s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-207007ce-a799-4731-9709-d8e1461072b3 tempest-CreateVolumesFromImageTest-856100807 None] Created reservations ['47a2afa6-94f6-4c44-a376-f03315ade8c7', 'a0f80418-549a-41d2-97b5-de5074d0008c', '07e8af89-d6a2-4509-9930-b1a4f2f823c6', 'bf0a0fe5-66f4-4254-bf23-9a664a47b831'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-207007ce-a799-4731-9709-d8e1461072b3 tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-207007ce-a799-4731-9709-d8e1461072b3 tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-207007ce-a799-4731-9709-d8e1461072b3 tempest-CreateVolumesFromImageTest-856100807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-207007ce-a799-4731-9709-d8e1461072b3 tempest-CreateVolumesFromImageTest-856100807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-207007ce-a799-4731-9709-d8e1461072b3 tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-207007ce-a799-4731-9709-d8e1461072b3 tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:16 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:45:16 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:16 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8437d9b-d98f-4d69-8ce6-5be5e40de2cb tempest-VolumeDependencyTests-1557140602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.info" returned: 0 in 0.255s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b8437d9b-d98f-4d69-8ce6-5be5e40de2cb tempest-VolumeDependencyTests-1557140602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.265s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.842s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f80440f1-e641-4700-8aff-17420ce83664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f74a9ef58c43c7b2e7d69b197028eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:12Z,use_quota=True,user_id='9096860427274f24b6a89432040dc10d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcd0c4d1-05a5-4618-88fd-bcf255052a1e),volume_type_id=fcd0c4d1-05a5-4618-88fd-bcf255052a1e)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Creating volume f80440f1-e641-4700-8aff-17420ce83664 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:16 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:45:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f80440f1-e641-4700-8aff-17420ce83664 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:16 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f80440f1-e641-4700-8aff-17420ce83664 1073741824 Nov 03 07:45:16 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:16 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b8437d9b-d98f-4d69-8ce6-5be5e40de2cb tempest-VolumeDependencyTests-1557140602 None] Create snapshot completed successfully Nov 03 07:45:17 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-207007ce-a799-4731-9709-d8e1461072b3 tempest-CreateVolumesFromImageTest-856100807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.264s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:17 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-207007ce-a799-4731-9709-d8e1461072b3 tempest-CreateVolumesFromImageTest-856100807 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:17 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-207007ce-a799-4731-9709-d8e1461072b3 tempest-CreateVolumesFromImageTest-856100807 None] Deleted volume successfully. Nov 03 07:45:17 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-08649954-f4dc-48ed-bf24-7468dfb306cf tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "cinder-7b713790-1e75-42b3-b579-bd7e33aa1155-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:17 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-207007ce-a799-4731-9709-d8e1461072b3 tempest-CreateVolumesFromImageTest-856100807 None] Lock "cinder-1a80cad5-0b00-48cb-8392-fd9a1282c504-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:17 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-08649954-f4dc-48ed-bf24-7468dfb306cf tempest-CreateVolumesFromImageTest-856100807 None] Lock "cinder-7b713790-1e75-42b3-b579-bd7e33aa1155-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:17 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-08649954-f4dc-48ed-bf24-7468dfb306cf tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "cinder-quobyte-7b713790-1e75-42b3-b579-bd7e33aa1155" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:17 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-08649954-f4dc-48ed-bf24-7468dfb306cf tempest-CreateVolumesFromImageTest-856100807 None] Lock "cinder-quobyte-7b713790-1e75-42b3-b579-bd7e33aa1155" acquired by "delete_volume" :: waited 0.025s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:17 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6ca943-e369-481c-8e92-a5985d2aa72c]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-08649954-f4dc-48ed-bf24-7468dfb306cf tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b713790-1e75-42b3-b579-bd7e33aa1155 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:17 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b713790-1e75-42b3-b579-bd7e33aa1155 Nov 03 07:45:17 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:17 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f80440f1-e641-4700-8aff-17420ce83664 1073741824" returned: 0 in 0.536s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f80440f1-e641-4700-8aff-17420ce83664 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:17 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f80440f1-e641-4700-8aff-17420ce83664 Nov 03 07:45:17 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:17 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-08649954-f4dc-48ed-bf24-7468dfb306cf tempest-CreateVolumesFromImageTest-856100807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b713790-1e75-42b3-b579-bd7e33aa1155" returned: 0 in 0.416s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-08649954-f4dc-48ed-bf24-7468dfb306cf tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b713790-1e75-42b3-b579-bd7e33aa1155 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:17 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b713790-1e75-42b3-b579-bd7e33aa1155 Nov 03 07:45:17 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:17 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f80440f1-e641-4700-8aff-17420ce83664" returned: 0 in 0.310s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:17 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:45:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-671b1073-25b3-4c36-adcc-ede6037a020a tempest-CinderUnicodeTest-1868854618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.566s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:17 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-671b1073-25b3-4c36-adcc-ede6037a020a tempest-CinderUnicodeTest-1868854618 None] Creating offline snapshot ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b of volume 0206ecc2-ec51-4d24-b19a-578a71ebe521 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:45:17 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e0865b-7ddd-444f-9135-f7f5ec6a6746]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-671b1073-25b3-4c36-adcc-ede6037a020a tempest-CinderUnicodeTest-1868854618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:17 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Attempting download of c4f4c0b2-63f4-438a-9ade-ef23b353209c ((None, [{'url': 'file:///opt/stack/data/glance/images/c4f4c0b2-63f4-438a-9ade-ef23b353209c', 'metadata': {}}])) to volume f80440f1-e641-4700-8aff-17420ce83664. {{(pid=87016) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 03 07:45:17 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f080d6-25a0-4953-bed5-b44a1b8a3478]: (4, 'raw') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4f4c0b2-63f4-438a-9ade-ef23b353209c_poryfov6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:17 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521 Nov 03 07:45:17 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:18 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4f4c0b2-63f4-438a-9ade-ef23b353209c_poryfov6 Nov 03 07:45:18 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:18 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-08649954-f4dc-48ed-bf24-7468dfb306cf tempest-CreateVolumesFromImageTest-856100807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7b713790-1e75-42b3-b579-bd7e33aa1155" returned: 0 in 0.433s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-08649954-f4dc-48ed-bf24-7468dfb306cf tempest-CreateVolumesFromImageTest-856100807 None] Lock "cinder-quobyte-7b713790-1e75-42b3-b579-bd7e33aa1155" released by "delete_volume" :: held 0.920s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Flow 'volume_create_manager' (359179d2-3eca-457a-aece-2c6c594de040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca3d335-d47c-44c2-bb9b-4fdda0f87b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca3d335-d47c-44c2-bb9b-4fdda0f87b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-693760477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29cc19e-1cd5-41a9-a9d8-36565f9a859b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99934a2f2ab548ce9f5f2ba8a49cf709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cc32c897-2b0f-41f8-9158-674a1ed47a5d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:18Z,use_quota=True,user_id='5a9ebe81a063481fb2208df2d7aade5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d5828e-0f17-46f4-a233-2d98923afbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:18 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d5828e-0f17-46f4-a233-2d98923afbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bbfe55e-35f5-4033-8ee8-d39983f9a958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bbfe55e-35f5-4033-8ee8-d39983f9a958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b29cc19e-1cd5-41a9-a9d8-36565f9a859b', 'volume_name': 'volume-b29cc19e-1cd5-41a9-a9d8-36565f9a859b', 'volume_size': 1, 'snapshot_id': 'cc32c897-2b0f-41f8-9158-674a1ed47a5d'}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8fb361-8e66-4160-9952-1f66baf9c1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8fb361-8e66-4160-9952-1f66baf9c1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f44c926-f0c6-449e-94c0-da601a3c06b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:18 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Volume b29cc19e-1cd5-41a9-a9d8-36565f9a859b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b29cc19e-1cd5-41a9-a9d8-36565f9a859b', 'volume_size': 1, 'snapshot_id': 'cc32c897-2b0f-41f8-9158-674a1ed47a5d'} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4f4c0b2-63f4-438a-9ade-ef23b353209c_poryfov6" returned: 0 in 0.482s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:18 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4f4c0b2-63f4-438a-9ade-ef23b353209c_poryfov6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-08649954-f4dc-48ed-bf24-7468dfb306cf tempest-CreateVolumesFromImageTest-856100807 None] Created reservations ['335451f0-7586-4e4f-ace8-d7707347fde4', 'f27b997b-f477-4984-87e4-7da294cf918a', '53f8bb21-a882-4b37-a24a-bf71943c7858', '12901911-2468-4cef-bf67-c445ce5c4a85'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-671b1073-25b3-4c36-adcc-ede6037a020a tempest-CinderUnicodeTest-1868854618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521" returned: 0 in 0.574s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-671b1073-25b3-4c36-adcc-ede6037a020a tempest-CinderUnicodeTest-1868854618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:18 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b 1G Nov 03 07:45:18 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-08649954-f4dc-48ed-bf24-7468dfb306cf tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-08649954-f4dc-48ed-bf24-7468dfb306cf tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-08649954-f4dc-48ed-bf24-7468dfb306cf tempest-CreateVolumesFromImageTest-856100807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-08649954-f4dc-48ed-bf24-7468dfb306cf tempest-CreateVolumesFromImageTest-856100807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-08649954-f4dc-48ed-bf24-7468dfb306cf tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-08649954-f4dc-48ed-bf24-7468dfb306cf tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:18 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4f4c0b2-63f4-438a-9ade-ef23b353209c_poryfov6 Nov 03 07:45:18 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:18 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:45:18 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:18 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4f4c0b2-63f4-438a-9ade-ef23b353209c_poryfov6" returned: 1 in 0.350s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4f4c0b2-63f4-438a-9ade-ef23b353209c_poryfov6' failed. Not Retrying. {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0d74ff-7ae7-4901-be35-22b133938fe3]: (4, 'raw') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:18 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-08649954-f4dc-48ed-bf24-7468dfb306cf tempest-CreateVolumesFromImageTest-856100807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.268s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-08649954-f4dc-48ed-bf24-7468dfb306cf tempest-CreateVolumesFromImageTest-856100807 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:18 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-08649954-f4dc-48ed-bf24-7468dfb306cf tempest-CreateVolumesFromImageTest-856100807 None] Deleted volume successfully. Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-08649954-f4dc-48ed-bf24-7468dfb306cf tempest-CreateVolumesFromImageTest-856100807 None] Lock "cinder-7b713790-1e75-42b3-b579-bd7e33aa1155-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:18 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-671b1073-25b3-4c36-adcc-ede6037a020a tempest-CinderUnicodeTest-1868854618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b 1G" returned: 0 in 0.460s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-671b1073-25b3-4c36-adcc-ede6037a020a tempest-CinderUnicodeTest-1868854618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0206ecc2-ec51-4d24-b19a-578a71ebe521 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:18 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD Nov 03 07:45:18 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:18 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0206ecc2-ec51-4d24-b19a-578a71ebe521 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b Nov 03 07:45:18 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:19 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:19 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-671b1073-25b3-4c36-adcc-ede6037a020a tempest-CinderUnicodeTest-1868854618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0206ecc2-ec51-4d24-b19a-578a71ebe521 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b" returned: 0 in 0.281s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:19 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-671b1073-25b3-4c36-adcc-ede6037a020a tempest-CinderUnicodeTest-1868854618 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b is being set with open permissions: ugo+rw Nov 03 07:45:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-671b1073-25b3-4c36-adcc-ede6037a020a tempest-CinderUnicodeTest-1868854618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:19 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b Nov 03 07:45:19 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:19 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD Nov 03 07:45:19 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:19 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-7a033a28-17d0-4da0-94d9-1da2e01646d0 tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "cinder-0f594b77-d5e4-4816-96b4-1ca89b625710-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-671b1073-25b3-4c36-adcc-ede6037a020a tempest-CinderUnicodeTest-1868854618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b" returned: 0 in 0.295s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-7a033a28-17d0-4da0-94d9-1da2e01646d0 tempest-CreateVolumesFromImageTest-856100807 None] Lock "cinder-0f594b77-d5e4-4816-96b4-1ca89b625710-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:19 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD" returned: 1 in 0.375s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:45:19 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] c4f4c0b2-63f4-438a-9ade-ef23b353209c was raw, converting to qcow2 {{(pid=87016) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:45:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f80440f1-e641-4700-8aff-17420ce83664 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-671b1073-25b3-4c36-adcc-ede6037a020a tempest-CinderUnicodeTest-1868854618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:19 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f80440f1-e641-4700-8aff-17420ce83664 Nov 03 07:45:19 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:19 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.info Nov 03 07:45:19 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-7a033a28-17d0-4da0-94d9-1da2e01646d0 tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "cinder-quobyte-0f594b77-d5e4-4816-96b4-1ca89b625710" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:19 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-7a033a28-17d0-4da0-94d9-1da2e01646d0 tempest-CreateVolumesFromImageTest-856100807 None] Lock "cinder-quobyte-0f594b77-d5e4-4816-96b4-1ca89b625710" acquired by "delete_volume" :: waited 0.017s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:19 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[72826dbf-1a7d-4d3b-9c2a-3117030b43a1]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7a033a28-17d0-4da0-94d9-1da2e01646d0 tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f594b77-d5e4-4816-96b4-1ca89b625710 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:19 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f594b77-d5e4-4816-96b4-1ca89b625710 Nov 03 07:45:19 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:19 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-671b1073-25b3-4c36-adcc-ede6037a020a tempest-CinderUnicodeTest-1868854618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.info" returned: 0 in 0.254s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:19 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-671b1073-25b3-4c36-adcc-ede6037a020a tempest-CinderUnicodeTest-1868854618 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.info is being set with open permissions: ugo+rw Nov 03 07:45:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-671b1073-25b3-4c36-adcc-ede6037a020a tempest-CinderUnicodeTest-1868854618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:19 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.info Nov 03 07:45:19 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:19 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f80440f1-e641-4700-8aff-17420ce83664" returned: 0 in 0.483s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:19 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c4f4c0b2-63f4-438a-9ade-ef23b353209c_tsj4c1zfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f80440f1-e641-4700-8aff-17420ce83664 {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:45:19 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 07:45:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f80440f1-e641-4700-8aff-17420ce83664 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:19 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7a033a28-17d0-4da0-94d9-1da2e01646d0 tempest-CreateVolumesFromImageTest-856100807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f594b77-d5e4-4816-96b4-1ca89b625710" returned: 0 in 0.382s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7a033a28-17d0-4da0-94d9-1da2e01646d0 tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f594b77-d5e4-4816-96b4-1ca89b625710 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:19 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f80440f1-e641-4700-8aff-17420ce83664 1G Nov 03 07:45:19 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:20 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:20 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f594b77-d5e4-4816-96b4-1ca89b625710 Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-671b1073-25b3-4c36-adcc-ede6037a020a tempest-CinderUnicodeTest-1868854618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.info" returned: 0 in 0.258s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:20 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-671b1073-25b3-4c36-adcc-ede6037a020a tempest-CinderUnicodeTest-1868854618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.267s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.634s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Acquiring lock "cinder-quobyte-cc32c897-2b0f-41f8-9158-674a1ed47a5d-b29cc19e-1cd5-41a9-a9d8-36565f9a859b" by "_create_volume_from_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Lock "cinder-quobyte-cc32c897-2b0f-41f8-9158-674a1ed47a5d-b29cc19e-1cd5-41a9-a9d8-36565f9a859b" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Creating volume b29cc19e-1cd5-41a9-a9d8-36565f9a859b from snapshot cc32c897-2b0f-41f8-9158-674a1ed47a5d {{(pid=87016) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Acquiring lock "cinder-quobyte-b29cc19e-1cd5-41a9-a9d8-36565f9a859b" by "_copy_volume_from_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:20 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-671b1073-25b3-4c36-adcc-ede6037a020a tempest-CinderUnicodeTest-1868854618 None] Create snapshot completed successfully Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Lock "cinder-quobyte-b29cc19e-1cd5-41a9-a9d8-36565f9a859b" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] snapshot: cc32c897-2b0f-41f8-9158-674a1ed47a5d, volume: b29cc19e-1cd5-41a9-a9d8-36565f9a859b, {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a966b3-bdf1-4022-9907-d03c716d6765]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.cc32c897-2b0f-41f8-9158-674a1ed47a5d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:20 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7a033a28-17d0-4da0-94d9-1da2e01646d0 tempest-CreateVolumesFromImageTest-856100807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f594b77-d5e4-4816-96b4-1ca89b625710" returned: 0 in 0.312s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-7a033a28-17d0-4da0-94d9-1da2e01646d0 tempest-CreateVolumesFromImageTest-856100807 None] Lock "cinder-quobyte-0f594b77-d5e4-4816-96b4-1ca89b625710" released by "delete_volume" :: held 0.749s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:20 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.cc32c897-2b0f-41f8-9158-674a1ed47a5d Nov 03 07:45:20 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:20 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f80440f1-e641-4700-8aff-17420ce83664 1G" returned: 0 in 0.430s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Downloaded image c4f4c0b2-63f4-438a-9ade-ef23b353209c ((None, [{'url': 'file:///opt/stack/data/glance/images/c4f4c0b2-63f4-438a-9ade-ef23b353209c', 'metadata': {}}])) to volume f80440f1-e641-4700-8aff-17420ce83664 successfully. {{(pid=87016) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Temporary image c4f4c0b2-63f4-438a-9ade-ef23b353209c for user 9096860427274f24b6a89432040dc10d is deleted. {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Marking volume f80440f1-e641-4700-8aff-17420ce83664 as bootable. {{(pid=87016) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-7a033a28-17d0-4da0-94d9-1da2e01646d0 tempest-CreateVolumesFromImageTest-856100807 None] Created reservations ['bc0ee30c-46fe-44fb-af79-4a41fb14d764', '247d6d8e-78fa-4667-8179-07c85259112c', 'dae68561-8af1-4a1c-b5ce-eb1cc901cc76', '9fe6bd77-0a83-4f04-871c-7434b95f499d'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Copying metadata from image c4f4c0b2-63f4-438a-9ade-ef23b353209c to f80440f1-e641-4700-8aff-17420ce83664. {{(pid=87016) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Creating volume glance metadata for volume f80440f1-e641-4700-8aff-17420ce83664 backed by image c4f4c0b2-63f4-438a-9ade-ef23b353209c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c4f4c0b2-63f4-438a-9ade-ef23b353209c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1e5d89836f30bee87a3df7a1ab8fc64c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87016) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7a033a28-17d0-4da0-94d9-1da2e01646d0 tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7a033a28-17d0-4da0-94d9-1da2e01646d0 tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7a033a28-17d0-4da0-94d9-1da2e01646d0 tempest-CreateVolumesFromImageTest-856100807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7a033a28-17d0-4da0-94d9-1da2e01646d0 tempest-CreateVolumesFromImageTest-856100807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7a033a28-17d0-4da0-94d9-1da2e01646d0 tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7a033a28-17d0-4da0-94d9-1da2e01646d0 tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-71016b12-ab2a-49f6-8df7-af7c7f3e0d41 tempest-CinderUnicodeTest-1868854618 None] Acquiring lock "cinder-ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:20 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:45:20 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89ad8e93-3d7f-4819-90d9-40827e546bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f80440f1-e641-4700-8aff-17420ce83664', 'volume_size': 1, 'image_id': 'c4f4c0b2-63f4-438a-9ade-ef23b353209c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4f4c0b2-63f4-438a-9ade-ef23b353209c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1e5d89836f30bee87a3df7a1ab8fc64c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '06f74a9ef58c43c7b2e7d69b197028eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '095e81c31010c0f10e3843c7ff115f7a9b6eb170b3f4df4904fe3514f62db0c432b2e8114daf8c8f0b421bfc8cfc6338c327f2039b8c52fed63028a3934c5464', 'id': 'c4f4c0b2-63f4-438a-9ade-ef23b353209c', 'created_at': datetime.datetime(2026, 11, 3, 6, 45, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 45, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4f4c0b2-63f4-438a-9ade-ef23b353209c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c2b19b-4885-4da3-a507-29b48b4496ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-71016b12-ab2a-49f6-8df7-af7c7f3e0d41 tempest-CinderUnicodeTest-1868854618 None] Lock "cinder-ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-71016b12-ab2a-49f6-8df7-af7c7f3e0d41 tempest-CinderUnicodeTest-1868854618 None] Acquiring lock "cinder-quobyte-0206ecc2-ec51-4d24-b19a-578a71ebe521" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f02e2962-e093-45ae-9b15-fdf9ff346464 tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "cinder-16132860-d045-46c0-b290-95bfc1dc9008-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:20 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Volume volume-f80440f1-e641-4700-8aff-17420ce83664 (f80440f1-e641-4700-8aff-17420ce83664): created successfully Nov 03 07:45:20 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c2b19b-4885-4da3-a507-29b48b4496ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Flow 'volume_create_manager' (ff50f54c-a931-4302-88aa-e9fc02bdb982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f02e2962-e093-45ae-9b15-fdf9ff346464 tempest-CreateVolumesFromImageTest-856100807 None] Lock "cinder-16132860-d045-46c0-b290-95bfc1dc9008-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.cc32c897-2b0f-41f8-9158-674a1ed47a5d" returned: 0 in 0.540s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-71016b12-ab2a-49f6-8df7-af7c7f3e0d41 tempest-CinderUnicodeTest-1868854618 None] Lock "cinder-quobyte-0206ecc2-ec51-4d24-b19a-578a71ebe521" acquired by "delete_snapshot" :: waited 0.079s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-71016b12-ab2a-49f6-8df7-af7c7f3e0d41 tempest-CinderUnicodeTest-1868854618 None] Acquiring lock "cinder-quobyte-ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[4494aff9-4018-4e56-a3ba-aeb3907a52fd]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:20 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-0720eacf-5fad-4d2e-ba46-bf28220aacdb tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Created volume successfully. Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-71016b12-ab2a-49f6-8df7-af7c7f3e0d41 tempest-CinderUnicodeTest-1868854618 None] Lock "cinder-quobyte-ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-71016b12-ab2a-49f6-8df7-af7c7f3e0d41 tempest-CinderUnicodeTest-1868854618 None] Deleting offline snapshot ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b of volume 0206ecc2-ec51-4d24-b19a-578a71ebe521 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-71016b12-ab2a-49f6-8df7-af7c7f3e0d41 tempest-CinderUnicodeTest-1868854618 None] snapshot_file for this snap is: volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd2f986-3503-4821-bfc2-e8230e354f0c]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-71016b12-ab2a-49f6-8df7-af7c7f3e0d41 tempest-CinderUnicodeTest-1868854618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f02e2962-e093-45ae-9b15-fdf9ff346464 tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "cinder-quobyte-16132860-d045-46c0-b290-95bfc1dc9008" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f02e2962-e093-45ae-9b15-fdf9ff346464 tempest-CreateVolumesFromImageTest-856100807 None] Lock "cinder-quobyte-16132860-d045-46c0-b290-95bfc1dc9008" acquired by "delete_volume" :: waited 0.021s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:20 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:20 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf Nov 03 07:45:20 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7a033a28-17d0-4da0-94d9-1da2e01646d0 tempest-CreateVolumesFromImageTest-856100807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.337s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-7a033a28-17d0-4da0-94d9-1da2e01646d0 tempest-CreateVolumesFromImageTest-856100807 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:20 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-7a033a28-17d0-4da0-94d9-1da2e01646d0 tempest-CreateVolumesFromImageTest-856100807 None] Deleted volume successfully. Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdd0d0d-725b-43bd-ae7b-e39324609f15]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f02e2962-e093-45ae-9b15-fdf9ff346464 tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-16132860-d045-46c0-b290-95bfc1dc9008 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-7a033a28-17d0-4da0-94d9-1da2e01646d0 tempest-CreateVolumesFromImageTest-856100807 None] Lock "cinder-0f594b77-d5e4-4816-96b4-1ca89b625710-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:20 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b Nov 03 07:45:20 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:21 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-16132860-d045-46c0-b290-95bfc1dc9008 Nov 03 07:45:21 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:21 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf" returned: 0 in 0.452s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Creating direct copy from snapshot {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG cinder.utils [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Path /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b29cc19e-1cd5-41a9-a9d8-36565f9a859b not found in is_blk_device check {{(pid=87016) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b29cc19e-1cd5-41a9-a9d8-36565f9a859b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:21 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b29cc19e-1cd5-41a9-a9d8-36565f9a859b Nov 03 07:45:21 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:21 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-71016b12-ab2a-49f6-8df7-af7c7f3e0d41 tempest-CinderUnicodeTest-1868854618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b" returned: 0 in 0.468s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-71016b12-ab2a-49f6-8df7-af7c7f3e0d41 tempest-CinderUnicodeTest-1868854618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0206ecc2-ec51-4d24-b19a-578a71ebe521(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:45:21 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f02e2962-e093-45ae-9b15-fdf9ff346464 tempest-CreateVolumesFromImageTest-856100807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-16132860-d045-46c0-b290-95bfc1dc9008" returned: 0 in 0.412s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f02e2962-e093-45ae-9b15-fdf9ff346464 tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-16132860-d045-46c0-b290-95bfc1dc9008 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6c3d26-d235-487e-a87a-5018907020a8]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-71016b12-ab2a-49f6-8df7-af7c7f3e0d41 tempest-CinderUnicodeTest-1868854618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:21 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-16132860-d045-46c0-b290-95bfc1dc9008 Nov 03 07:45:21 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:21 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521 Nov 03 07:45:21 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6528209c-f5a0-475e-82e0-308309d06307 tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Acquiring lock "cinder-f80440f1-e641-4700-8aff-17420ce83664-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6528209c-f5a0-475e-82e0-308309d06307 tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Lock "cinder-f80440f1-e641-4700-8aff-17420ce83664-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:21 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f02e2962-e093-45ae-9b15-fdf9ff346464 tempest-CreateVolumesFromImageTest-856100807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-16132860-d045-46c0-b290-95bfc1dc9008" returned: 0 in 0.332s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f02e2962-e093-45ae-9b15-fdf9ff346464 tempest-CreateVolumesFromImageTest-856100807 None] Lock "cinder-quobyte-16132860-d045-46c0-b290-95bfc1dc9008" released by "delete_volume" :: held 0.809s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6528209c-f5a0-475e-82e0-308309d06307 tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Acquiring lock "cinder-quobyte-f80440f1-e641-4700-8aff-17420ce83664" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6528209c-f5a0-475e-82e0-308309d06307 tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Lock "cinder-quobyte-f80440f1-e641-4700-8aff-17420ce83664" acquired by "delete_volume" :: waited 0.034s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-f02e2962-e093-45ae-9b15-fdf9ff346464 tempest-CreateVolumesFromImageTest-856100807 None] Created reservations ['9482072d-adc4-4e2a-bb5b-27c4e8508575', 'f3feaa6f-55a2-400b-ad5b-9e9d163c7362', '87ae3493-30d4-4d96-8518-4663fd596eda', '5b64c6a8-4b65-431a-b452-7c6a3ec36343'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[16601268-caeb-4bcf-b4e5-fa2d3d0392a8]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6528209c-f5a0-475e-82e0-308309d06307 tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f80440f1-e641-4700-8aff-17420ce83664 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:21 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-71016b12-ab2a-49f6-8df7-af7c7f3e0d41 tempest-CinderUnicodeTest-1868854618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521" returned: 0 in 0.471s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-71016b12-ab2a-49f6-8df7-af7c7f3e0d41 tempest-CinderUnicodeTest-1868854618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:21 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b Nov 03 07:45:21 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:21 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f80440f1-e641-4700-8aff-17420ce83664 Nov 03 07:45:21 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f02e2962-e093-45ae-9b15-fdf9ff346464 tempest-CreateVolumesFromImageTest-856100807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f02e2962-e093-45ae-9b15-fdf9ff346464 tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f02e2962-e093-45ae-9b15-fdf9ff346464 tempest-CreateVolumesFromImageTest-856100807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:22 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f02e2962-e093-45ae-9b15-fdf9ff346464 tempest-CreateVolumesFromImageTest-856100807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f02e2962-e093-45ae-9b15-fdf9ff346464 tempest-CreateVolumesFromImageTest-856100807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f02e2962-e093-45ae-9b15-fdf9ff346464 tempest-CreateVolumesFromImageTest-856100807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:22 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:45:22 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:22 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6528209c-f5a0-475e-82e0-308309d06307 tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f80440f1-e641-4700-8aff-17420ce83664" returned: 0 in 0.714s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6528209c-f5a0-475e-82e0-308309d06307 tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f80440f1-e641-4700-8aff-17420ce83664 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:22 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f02e2962-e093-45ae-9b15-fdf9ff346464 tempest-CreateVolumesFromImageTest-856100807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.555s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:22 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-f02e2962-e093-45ae-9b15-fdf9ff346464 tempest-CreateVolumesFromImageTest-856100807 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:22 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f80440f1-e641-4700-8aff-17420ce83664 Nov 03 07:45:22 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:22 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-f02e2962-e093-45ae-9b15-fdf9ff346464 tempest-CreateVolumesFromImageTest-856100807 None] Deleted volume successfully. Nov 03 07:45:22 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-71016b12-ab2a-49f6-8df7-af7c7f3e0d41 tempest-CinderUnicodeTest-1868854618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b" returned: 0 in 0.798s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-71016b12-ab2a-49f6-8df7-af7c7f3e0d41 tempest-CinderUnicodeTest-1868854618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:22 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f02e2962-e093-45ae-9b15-fdf9ff346464 tempest-CreateVolumesFromImageTest-856100807 None] Lock "cinder-16132860-d045-46c0-b290-95bfc1dc9008-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:22 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b Nov 03 07:45:22 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:22 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6528209c-f5a0-475e-82e0-308309d06307 tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f80440f1-e641-4700-8aff-17420ce83664" returned: 0 in 0.445s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:22 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6528209c-f5a0-475e-82e0-308309d06307 tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Lock "cinder-quobyte-f80440f1-e641-4700-8aff-17420ce83664" released by "delete_volume" :: held 1.222s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:23 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-6528209c-f5a0-475e-82e0-308309d06307 tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Created reservations ['e589bb64-1943-45c0-9002-f9982dfc954f', '05c79839-33f5-483b-a56f-08df90392ff2', '281816e7-97c6-458a-910b-038dbc627449', 'ff3ba2f0-6c76-487e-b9e4-ac0662a16771'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:23 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-71016b12-ab2a-49f6-8df7-af7c7f3e0d41 tempest-CinderUnicodeTest-1868854618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521.ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b" returned: 0 in 0.511s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:23 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-71016b12-ab2a-49f6-8df7-af7c7f3e0d41 tempest-CinderUnicodeTest-1868854618 None] Lock "cinder-quobyte-ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b" released by "_delete_snapshot" :: held 2.447s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:23 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-71016b12-ab2a-49f6-8df7-af7c7f3e0d41 tempest-CinderUnicodeTest-1868854618 None] Lock "cinder-quobyte-0206ecc2-ec51-4d24-b19a-578a71ebe521" released by "delete_snapshot" :: held 2.505s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6528209c-f5a0-475e-82e0-308309d06307 tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6528209c-f5a0-475e-82e0-308309d06307 tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6528209c-f5a0-475e-82e0-308309d06307 tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6528209c-f5a0-475e-82e0-308309d06307 tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6528209c-f5a0-475e-82e0-308309d06307 tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6528209c-f5a0-475e-82e0-308309d06307 tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:23 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:45:23 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:23 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-71016b12-ab2a-49f6-8df7-af7c7f3e0d41 tempest-CinderUnicodeTest-1868854618 None] Created reservations ['69bc069a-1102-4bf4-8f79-f98be9dc0b61', 'a1c73977-8c1b-4b60-8715-952a82a8052b', '2261265b-5afe-461f-8a03-fbe773238511', 'c7811d61-0d91-4370-a117-9780b199da86'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:23 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-71016b12-ab2a-49f6-8df7-af7c7f3e0d41 tempest-CinderUnicodeTest-1868854618 None] Delete snapshot completed successfully. Nov 03 07:45:23 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-71016b12-ab2a-49f6-8df7-af7c7f3e0d41 tempest-CinderUnicodeTest-1868854618 None] Lock "cinder-ce6d5b41-9d2e-4a9f-899c-fbaaf8976b2b-delete_snapshot" released by "delete_snapshot" :: held 2.945s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:23 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6528209c-f5a0-475e-82e0-308309d06307 tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.488s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:23 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-6528209c-f5a0-475e-82e0-308309d06307 tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:23 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-6528209c-f5a0-475e-82e0-308309d06307 tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Deleted volume successfully. Nov 03 07:45:23 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6528209c-f5a0-475e-82e0-308309d06307 tempest-VolumeAndVolumeTypeFromImageTest-1353767365 None] Lock "cinder-f80440f1-e641-4700-8aff-17420ce83664-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:23 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e1d8ad43-b320-4d4c-b4b4-2ba38ec8361b tempest-CinderUnicodeTest-1868854618 None] Acquiring lock "cinder-0206ecc2-ec51-4d24-b19a-578a71ebe521-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:24 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e1d8ad43-b320-4d4c-b4b4-2ba38ec8361b tempest-CinderUnicodeTest-1868854618 None] Lock "cinder-0206ecc2-ec51-4d24-b19a-578a71ebe521-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:24 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e1d8ad43-b320-4d4c-b4b4-2ba38ec8361b tempest-CinderUnicodeTest-1868854618 None] Acquiring lock "cinder-quobyte-0206ecc2-ec51-4d24-b19a-578a71ebe521" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:24 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e1d8ad43-b320-4d4c-b4b4-2ba38ec8361b tempest-CinderUnicodeTest-1868854618 None] Lock "cinder-quobyte-0206ecc2-ec51-4d24-b19a-578a71ebe521" acquired by "delete_volume" :: waited 0.043s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:24 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9aeb29-0fec-41da-8046-0f86ed0611dc]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e1d8ad43-b320-4d4c-b4b4-2ba38ec8361b tempest-CinderUnicodeTest-1868854618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:24 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521 Nov 03 07:45:24 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e1d8ad43-b320-4d4c-b4b4-2ba38ec8361b tempest-CinderUnicodeTest-1868854618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521" returned: 0 in 0.834s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e1d8ad43-b320-4d4c-b4b4-2ba38ec8361b tempest-CinderUnicodeTest-1868854618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:25 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:25 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521 Nov 03 07:45:25 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:25 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e1d8ad43-b320-4d4c-b4b4-2ba38ec8361b tempest-CinderUnicodeTest-1868854618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0206ecc2-ec51-4d24-b19a-578a71ebe521" returned: 0 in 0.623s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:25 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e1d8ad43-b320-4d4c-b4b4-2ba38ec8361b tempest-CinderUnicodeTest-1868854618 None] Lock "cinder-quobyte-0206ecc2-ec51-4d24-b19a-578a71ebe521" released by "delete_volume" :: held 1.653s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:25 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-e1d8ad43-b320-4d4c-b4b4-2ba38ec8361b tempest-CinderUnicodeTest-1868854618 None] Created reservations ['5fe17be1-682c-4cbd-bd24-9c386fa72837', '76e0fe55-be7e-4754-9f53-577e61a6f7a8', '664bbbf5-c6be-46dc-8e92-52c3273bbf82', '219090e1-80f9-42ae-9e25-05023865896f'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e1d8ad43-b320-4d4c-b4b4-2ba38ec8361b tempest-CinderUnicodeTest-1868854618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e1d8ad43-b320-4d4c-b4b4-2ba38ec8361b tempest-CinderUnicodeTest-1868854618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e1d8ad43-b320-4d4c-b4b4-2ba38ec8361b tempest-CinderUnicodeTest-1868854618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e1d8ad43-b320-4d4c-b4b4-2ba38ec8361b tempest-CinderUnicodeTest-1868854618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e1d8ad43-b320-4d4c-b4b4-2ba38ec8361b tempest-CinderUnicodeTest-1868854618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e1d8ad43-b320-4d4c-b4b4-2ba38ec8361b tempest-CinderUnicodeTest-1868854618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:26 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:45:26 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:26 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-43821957-d917-41c7-8bc9-ee14effd463d tempest-CinderUnicodeTest-1868854618 None] Acquiring lock "cinder-fa762b9f-2645-49c4-a074-8ca76d1b8867-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:26 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-43821957-d917-41c7-8bc9-ee14effd463d tempest-CinderUnicodeTest-1868854618 None] Lock "cinder-fa762b9f-2645-49c4-a074-8ca76d1b8867-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:26 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-43821957-d917-41c7-8bc9-ee14effd463d tempest-CinderUnicodeTest-1868854618 None] Acquiring lock "cinder-quobyte-fa762b9f-2645-49c4-a074-8ca76d1b8867" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:26 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-43821957-d917-41c7-8bc9-ee14effd463d tempest-CinderUnicodeTest-1868854618 None] Lock "cinder-quobyte-fa762b9f-2645-49c4-a074-8ca76d1b8867" acquired by "delete_volume" :: waited 0.077s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:26 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ebca4f-b1c4-4705-bba6-fd5439bc6a3a]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-43821957-d917-41c7-8bc9-ee14effd463d tempest-CinderUnicodeTest-1868854618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa762b9f-2645-49c4-a074-8ca76d1b8867 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:27 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e1d8ad43-b320-4d4c-b4b4-2ba38ec8361b tempest-CinderUnicodeTest-1868854618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.804s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:27 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-e1d8ad43-b320-4d4c-b4b4-2ba38ec8361b tempest-CinderUnicodeTest-1868854618 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:27 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-e1d8ad43-b320-4d4c-b4b4-2ba38ec8361b tempest-CinderUnicodeTest-1868854618 None] Deleted volume successfully. Nov 03 07:45:27 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e1d8ad43-b320-4d4c-b4b4-2ba38ec8361b tempest-CinderUnicodeTest-1868854618 None] Lock "cinder-0206ecc2-ec51-4d24-b19a-578a71ebe521-delete_volume" released by "delete_volume" :: held 3.103s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:27 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa762b9f-2645-49c4-a074-8ca76d1b8867 Nov 03 07:45:27 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:27 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-43821957-d917-41c7-8bc9-ee14effd463d tempest-CinderUnicodeTest-1868854618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa762b9f-2645-49c4-a074-8ca76d1b8867" returned: 0 in 1.012s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-43821957-d917-41c7-8bc9-ee14effd463d tempest-CinderUnicodeTest-1868854618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa762b9f-2645-49c4-a074-8ca76d1b8867 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:28 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa762b9f-2645-49c4-a074-8ca76d1b8867 Nov 03 07:45:28 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:28 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-43821957-d917-41c7-8bc9-ee14effd463d tempest-CinderUnicodeTest-1868854618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa762b9f-2645-49c4-a074-8ca76d1b8867" returned: 0 in 0.444s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:28 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-43821957-d917-41c7-8bc9-ee14effd463d tempest-CinderUnicodeTest-1868854618 None] Lock "cinder-quobyte-fa762b9f-2645-49c4-a074-8ca76d1b8867" released by "delete_volume" :: held 1.589s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:28 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-43821957-d917-41c7-8bc9-ee14effd463d tempest-CinderUnicodeTest-1868854618 None] Created reservations ['55439e4e-5ae4-4f6d-93f9-54c81fb45d6d', '6b8d0c72-54fd-44d7-895c-1ed3ecfae4b8', '53f7a128-a58a-42e4-aac5-47312f62b457', '622a4191-2b29-45a6-9979-1f5c41389e1f'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-43821957-d917-41c7-8bc9-ee14effd463d tempest-CinderUnicodeTest-1868854618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-43821957-d917-41c7-8bc9-ee14effd463d tempest-CinderUnicodeTest-1868854618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-43821957-d917-41c7-8bc9-ee14effd463d tempest-CinderUnicodeTest-1868854618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-43821957-d917-41c7-8bc9-ee14effd463d tempest-CinderUnicodeTest-1868854618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-43821957-d917-41c7-8bc9-ee14effd463d tempest-CinderUnicodeTest-1868854618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-43821957-d917-41c7-8bc9-ee14effd463d tempest-CinderUnicodeTest-1868854618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:28 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:45:28 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:29 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-43821957-d917-41c7-8bc9-ee14effd463d tempest-CinderUnicodeTest-1868854618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.698s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:29 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-43821957-d917-41c7-8bc9-ee14effd463d tempest-CinderUnicodeTest-1868854618 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:29 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-43821957-d917-41c7-8bc9-ee14effd463d tempest-CinderUnicodeTest-1868854618 None] Deleted volume successfully. Nov 03 07:45:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-43821957-d917-41c7-8bc9-ee14effd463d tempest-CinderUnicodeTest-1868854618 None] Lock "cinder-fa762b9f-2645-49c4-a074-8ca76d1b8867-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:30 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b29cc19e-1cd5-41a9-a9d8-36565f9a859b" returned: 0 in 9.280s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:30 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Image conversion details: src /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf, size 1024.00 MB, duration 9.28 sec, destination /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b29cc19e-1cd5-41a9-a9d8-36565f9a859b {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:45:30 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Converted 1024.00 MB image at 110.33 MB/s Nov 03 07:45:30 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b29cc19e-1cd5-41a9-a9d8-36565f9a859b is being set with open permissions: ugo+rw Nov 03 07:45:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b29cc19e-1cd5-41a9-a9d8-36565f9a859b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:30 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b29cc19e-1cd5-41a9-a9d8-36565f9a859b Nov 03 07:45:30 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:30 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b29cc19e-1cd5-41a9-a9d8-36565f9a859b" returned: 0 in 0.315s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Lock "cinder-quobyte-b29cc19e-1cd5-41a9-a9d8-36565f9a859b" released by "_copy_volume_from_snapshot" :: held 10.701s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:30 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Lock "cinder-quobyte-cc32c897-2b0f-41f8-9158-674a1ed47a5d-b29cc19e-1cd5-41a9-a9d8-36565f9a859b" released by "_create_volume_from_snapshot" :: held 10.816s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.860s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f44c926-f0c6-449e-94c0-da601a3c06b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b29cc19e-1cd5-41a9-a9d8-36565f9a859b', 'volume_size': 1, 'snapshot_id': 'cc32c897-2b0f-41f8-9158-674a1ed47a5d'}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad92fda-133f-42f8-b971-1e82f01458c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:30 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Volume volume-b29cc19e-1cd5-41a9-a9d8-36565f9a859b (b29cc19e-1cd5-41a9-a9d8-36565f9a859b): created successfully Nov 03 07:45:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad92fda-133f-42f8-b971-1e82f01458c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Flow 'volume_create_manager' (359179d2-3eca-457a-aece-2c6c594de040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:31 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-2324d3fd-f5b9-4817-a41c-9415da66c932 tempest-VolumeDependencyTests-1557140602 None] Created volume successfully. Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Flow 'volume_create_manager' (a7738e90-1171-429c-af88-3ede1da7e43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49860583-478d-49c9-91e0-d05609968a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49860583-478d-49c9-91e0-d05609968a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-932231414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f72970-01d2-418e-a48e-c714e4481c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c848ad093948bb8b3826bd9c13ff44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:31Z,use_quota=True,user_id='5886febc1aa44772bf1096dade659b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2f05d8-50bd-4bfd-8fc7-a13dd5230183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2f05d8-50bd-4bfd-8fc7-a13dd5230183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45dac54-844a-42f0-aaca-d9b734c3b5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45dac54-844a-42f0-aaca-d9b734c3b5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8f72970-01d2-418e-a48e-c714e4481c9c', 'volume_name': 'volume-a8f72970-01d2-418e-a48e-c714e4481c9c', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04f9a38-6eed-4e5e-99e3-712f0a7e9307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04f9a38-6eed-4e5e-99e3-712f0a7e9307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba991832-d377-4591-b2be-bd450a4f6501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:31 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Volume a8f72970-01d2-418e-a48e-c714e4481c9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8f72970-01d2-418e-a48e-c714e4481c9c', 'volume_size': 1} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-932231414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f72970-01d2-418e-a48e-c714e4481c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c848ad093948bb8b3826bd9c13ff44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:31Z,use_quota=True,user_id='5886febc1aa44772bf1096dade659b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Creating volume a8f72970-01d2-418e-a48e-c714e4481c9c {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:31 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:31 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c 1073741824 Nov 03 07:45:31 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cf351659-837a-4f71-adfc-6de507f7d26e tempest-VolumeDependencyTests-1557140602 None] Acquiring lock "cinder-cc32c897-2b0f-41f8-9158-674a1ed47a5d-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cf351659-837a-4f71-adfc-6de507f7d26e tempest-VolumeDependencyTests-1557140602 None] Lock "cinder-cc32c897-2b0f-41f8-9158-674a1ed47a5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cf351659-837a-4f71-adfc-6de507f7d26e tempest-VolumeDependencyTests-1557140602 None] Acquiring lock "cinder-quobyte-0f3586f6-4ff0-48d0-be45-5f5083106bbf" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cf351659-837a-4f71-adfc-6de507f7d26e tempest-VolumeDependencyTests-1557140602 None] Lock "cinder-quobyte-0f3586f6-4ff0-48d0-be45-5f5083106bbf" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cf351659-837a-4f71-adfc-6de507f7d26e tempest-VolumeDependencyTests-1557140602 None] Acquiring lock "cinder-quobyte-cc32c897-2b0f-41f8-9158-674a1ed47a5d" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cf351659-837a-4f71-adfc-6de507f7d26e tempest-VolumeDependencyTests-1557140602 None] Lock "cinder-quobyte-cc32c897-2b0f-41f8-9158-674a1ed47a5d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-cf351659-837a-4f71-adfc-6de507f7d26e tempest-VolumeDependencyTests-1557140602 None] Deleting offline snapshot cc32c897-2b0f-41f8-9158-674a1ed47a5d of volume 0f3586f6-4ff0-48d0-be45-5f5083106bbf {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-cf351659-837a-4f71-adfc-6de507f7d26e tempest-VolumeDependencyTests-1557140602 None] snapshot_file for this snap is: volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.cc32c897-2b0f-41f8-9158-674a1ed47a5d {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c96b1b9-4b05-44b0-bbda-eb5ab473e04a]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cf351659-837a-4f71-adfc-6de507f7d26e tempest-VolumeDependencyTests-1557140602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.cc32c897-2b0f-41f8-9158-674a1ed47a5d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:31 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c 1073741824" returned: 0 in 0.522s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:31 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.cc32c897-2b0f-41f8-9158-674a1ed47a5d Nov 03 07:45:31 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:32 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c Nov 03 07:45:32 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:32 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cf351659-837a-4f71-adfc-6de507f7d26e tempest-VolumeDependencyTests-1557140602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.cc32c897-2b0f-41f8-9158-674a1ed47a5d" returned: 0 in 0.518s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:32 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-cf351659-837a-4f71-adfc-6de507f7d26e tempest-VolumeDependencyTests-1557140602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:45:32 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[5040a212-c545-42af-ba1e-a044fb830ee1]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cf351659-837a-4f71-adfc-6de507f7d26e tempest-VolumeDependencyTests-1557140602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:32 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c" returned: 0 in 0.398s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:32 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:45:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:32 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba991832-d377-4591-b2be-bd450a4f6501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8f72970-01d2-418e-a48e-c714e4481c9c', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:32 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b027bf-fe2e-415c-9e00-db5e808e1a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:32 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Volume volume-a8f72970-01d2-418e-a48e-c714e4481c9c (a8f72970-01d2-418e-a48e-c714e4481c9c): created successfully Nov 03 07:45:32 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b027bf-fe2e-415c-9e00-db5e808e1a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:32 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Flow 'volume_create_manager' (a7738e90-1171-429c-af88-3ede1da7e43a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:32 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-7f7f3872-dc08-477a-b632-4b9001b9c115 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Created volume successfully. Nov 03 07:45:32 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf Nov 03 07:45:32 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:32 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cf351659-837a-4f71-adfc-6de507f7d26e tempest-VolumeDependencyTests-1557140602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf" returned: 0 in 0.596s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cf351659-837a-4f71-adfc-6de507f7d26e tempest-VolumeDependencyTests-1557140602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.cc32c897-2b0f-41f8-9158-674a1ed47a5d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:33 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.cc32c897-2b0f-41f8-9158-674a1ed47a5d Nov 03 07:45:33 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Flow 'volume_create_manager' (f860db4c-97f3-4bf6-a1a6-cf15459ba9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4511bd01-04e6-4da5-975d-9c4e9dab28ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4511bd01-04e6-4da5-975d-9c4e9dab28ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-723980914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0c7346-8af9-4288-bb4a-b766f6936e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2196361ea84e4634b391f8e50aec88e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:33Z,use_quota=True,user_id='1877228a1c4f49c9927b3d5e2b82d912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4521b3b-5394-4602-8761-c16e4f398446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:33 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4521b3b-5394-4602-8761-c16e4f398446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c757ee48-a9cf-4efb-b3f6-b3aa365922b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c757ee48-a9cf-4efb-b3f6-b3aa365922b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e0c7346-8af9-4288-bb4a-b766f6936e6a', 'volume_name': 'volume-3e0c7346-8af9-4288-bb4a-b766f6936e6a', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b170bc8-d210-43e1-aa0a-a231d8ccd6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b170bc8-d210-43e1-aa0a-a231d8ccd6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16889d59-6c2a-4a49-b447-da0d274128bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:33 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Volume 3e0c7346-8af9-4288-bb4a-b766f6936e6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e0c7346-8af9-4288-bb4a-b766f6936e6a', 'volume_size': 1} Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-723980914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0c7346-8af9-4288-bb4a-b766f6936e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2196361ea84e4634b391f8e50aec88e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:33Z,use_quota=True,user_id='1877228a1c4f49c9927b3d5e2b82d912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Creating volume 3e0c7346-8af9-4288-bb4a-b766f6936e6a {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:33 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3e0c7346-8af9-4288-bb4a-b766f6936e6a 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cf351659-837a-4f71-adfc-6de507f7d26e tempest-VolumeDependencyTests-1557140602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.cc32c897-2b0f-41f8-9158-674a1ed47a5d" returned: 0 in 0.633s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cf351659-837a-4f71-adfc-6de507f7d26e tempest-VolumeDependencyTests-1557140602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.cc32c897-2b0f-41f8-9158-674a1ed47a5d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:33 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3e0c7346-8af9-4288-bb4a-b766f6936e6a 1073741824 Nov 03 07:45:33 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:33 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.cc32c897-2b0f-41f8-9158-674a1ed47a5d Nov 03 07:45:33 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-48a4978f-b6c9-4515-9825-76e3b415116e tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:33 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cf351659-837a-4f71-adfc-6de507f7d26e tempest-VolumeDependencyTests-1557140602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf.cc32c897-2b0f-41f8-9158-674a1ed47a5d" returned: 0 in 0.310s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cf351659-837a-4f71-adfc-6de507f7d26e tempest-VolumeDependencyTests-1557140602 None] Lock "cinder-quobyte-cc32c897-2b0f-41f8-9158-674a1ed47a5d" released by "_delete_snapshot" :: held 2.178s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cf351659-837a-4f71-adfc-6de507f7d26e tempest-VolumeDependencyTests-1557140602 None] Lock "cinder-quobyte-0f3586f6-4ff0-48d0-be45-5f5083106bbf" released by "delete_snapshot" :: held 2.210s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-cf351659-837a-4f71-adfc-6de507f7d26e tempest-VolumeDependencyTests-1557140602 None] Created reservations ['7d0230b3-20c6-40fc-9b6c-110bc03ac1ff', '6c7b1eee-066e-4184-acb2-cbc3b298f003', 'cbbb4206-ed94-44c2-9f6b-0f42e8378e2c', '47a1f45a-f94a-4dfa-be7c-c03b0d788f4c'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:34 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-cf351659-837a-4f71-adfc-6de507f7d26e tempest-VolumeDependencyTests-1557140602 None] Delete snapshot completed successfully. Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cf351659-837a-4f71-adfc-6de507f7d26e tempest-VolumeDependencyTests-1557140602 None] Lock "cinder-cc32c897-2b0f-41f8-9158-674a1ed47a5d-delete_snapshot" released by "delete_snapshot" :: held 2.382s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:34 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3e0c7346-8af9-4288-bb4a-b766f6936e6a 1073741824" returned: 0 in 0.569s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3e0c7346-8af9-4288-bb4a-b766f6936e6a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:34 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3e0c7346-8af9-4288-bb4a-b766f6936e6a Nov 03 07:45:34 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:34 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3e0c7346-8af9-4288-bb4a-b766f6936e6a" returned: 0 in 0.260s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-48a4978f-b6c9-4515-9825-76e3b415116e tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.733s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16889d59-6c2a-4a49-b447-da0d274128bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e0c7346-8af9-4288-bb4a-b766f6936e6a', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9cc883-b1b5-4a35-9dd8-6c1c0e744518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-48a4978f-b6c9-4515-9825-76e3b415116e tempest-CreateVolumesFromSnapshotTest-1376318347 None] Creating offline snapshot 0e343f65-ca78-4a70-974a-9c42f5a91a6e of volume a8f72970-01d2-418e-a48e-c714e4481c9c {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:45:34 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Volume volume-3e0c7346-8af9-4288-bb4a-b766f6936e6a (3e0c7346-8af9-4288-bb4a-b766f6936e6a): created successfully Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9cc883-b1b5-4a35-9dd8-6c1c0e744518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Flow 'volume_create_manager' (f860db4c-97f3-4bf6-a1a6-cf15459ba9f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9299833-5b5e-4338-975f-a8978e4633b0]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-48a4978f-b6c9-4515-9825-76e3b415116e tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Flow 'volume_create_manager' (6ba2cc0d-bb5c-4b3a-b5bc-d8206d2ef55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (276f7d84-1f32-4c76-903f-54a51f42bcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:34 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-7deb9db5-275b-4a5b-929a-7a865d44aa87 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Created volume successfully. Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (276f7d84-1f32-4c76-903f-54a51f42bcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1403683095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6bf3fb-cff4-4ebf-b695-992ee409a0e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed98c25bc1c64da3a0227cf8c7bef103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:34Z,use_quota=True,user_id='3b3ce7b9c2864a2db5285861bf4701c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7c2903-333c-4eec-af34-85b15e7bb87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7c2903-333c-4eec-af34-85b15e7bb87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3d2217-a256-431e-b95f-77724f7f51ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3d2217-a256-431e-b95f-77724f7f51ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a6bf3fb-cff4-4ebf-b695-992ee409a0e6', 'volume_name': 'volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68e8b3b-8cfe-42e0-822d-56cb35f12123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68e8b3b-8cfe-42e0-822d-56cb35f12123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd0926d-54e7-4c06-be14-f694870bde4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:34 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Volume 8a6bf3fb-cff4-4ebf-b695-992ee409a0e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6', 'volume_size': 1} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:34 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c Nov 03 07:45:34 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0dcead6a-0806-4ad3-b09a-cf2276bea266 tempest-VolumeDependencyTests-1557140602 None] Acquiring lock "cinder-0f3586f6-4ff0-48d0-be45-5f5083106bbf-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:34 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-48a4978f-b6c9-4515-9825-76e3b415116e tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c" returned: 0 in 0.366s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-48a4978f-b6c9-4515-9825-76e3b415116e tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.0e343f65-ca78-4a70-974a-9c42f5a91a6e 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0dcead6a-0806-4ad3-b09a-cf2276bea266 tempest-VolumeDependencyTests-1557140602 None] Lock "cinder-0f3586f6-4ff0-48d0-be45-5f5083106bbf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:34 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.0e343f65-ca78-4a70-974a-9c42f5a91a6e 1G Nov 03 07:45:34 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0dcead6a-0806-4ad3-b09a-cf2276bea266 tempest-VolumeDependencyTests-1557140602 None] Acquiring lock "cinder-quobyte-0f3586f6-4ff0-48d0-be45-5f5083106bbf" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:34 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0dcead6a-0806-4ad3-b09a-cf2276bea266 tempest-VolumeDependencyTests-1557140602 None] Lock "cinder-quobyte-0f3586f6-4ff0-48d0-be45-5f5083106bbf" acquired by "delete_volume" :: waited 0.016s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:35 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba21f022-8d37-405c-8a72-92304860ffb1]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0dcead6a-0806-4ad3-b09a-cf2276bea266 tempest-VolumeDependencyTests-1557140602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:35 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf Nov 03 07:45:35 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:35 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-48a4978f-b6c9-4515-9825-76e3b415116e tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.0e343f65-ca78-4a70-974a-9c42f5a91a6e 1G" returned: 0 in 0.425s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-48a4978f-b6c9-4515-9825-76e3b415116e tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8f72970-01d2-418e-a48e-c714e4481c9c -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.0e343f65-ca78-4a70-974a-9c42f5a91a6e {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:35 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8f72970-01d2-418e-a48e-c714e4481c9c -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.0e343f65-ca78-4a70-974a-9c42f5a91a6e Nov 03 07:45:35 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:35 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0dcead6a-0806-4ad3-b09a-cf2276bea266 tempest-VolumeDependencyTests-1557140602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf" returned: 0 in 0.423s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0dcead6a-0806-4ad3-b09a-cf2276bea266 tempest-VolumeDependencyTests-1557140602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:35 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf Nov 03 07:45:35 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:35 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-48a4978f-b6c9-4515-9825-76e3b415116e tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8f72970-01d2-418e-a48e-c714e4481c9c -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.0e343f65-ca78-4a70-974a-9c42f5a91a6e" returned: 0 in 0.345s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:35 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-48a4978f-b6c9-4515-9825-76e3b415116e tempest-CreateVolumesFromSnapshotTest-1376318347 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.0e343f65-ca78-4a70-974a-9c42f5a91a6e is being set with open permissions: ugo+rw Nov 03 07:45:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-48a4978f-b6c9-4515-9825-76e3b415116e tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.0e343f65-ca78-4a70-974a-9c42f5a91a6e {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:35 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.0e343f65-ca78-4a70-974a-9c42f5a91a6e Nov 03 07:45:35 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:35 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0dcead6a-0806-4ad3-b09a-cf2276bea266 tempest-VolumeDependencyTests-1557140602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-0f3586f6-4ff0-48d0-be45-5f5083106bbf" returned: 0 in 0.305s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0dcead6a-0806-4ad3-b09a-cf2276bea266 tempest-VolumeDependencyTests-1557140602 None] Lock "cinder-quobyte-0f3586f6-4ff0-48d0-be45-5f5083106bbf" released by "delete_volume" :: held 0.820s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:35 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-0dcead6a-0806-4ad3-b09a-cf2276bea266 tempest-VolumeDependencyTests-1557140602 None] Created reservations ['a86b1c34-82ef-492e-bb0f-a2b0a9a04143', '023e54d6-4ffb-4f96-9636-c4c98873dd87', '5a1cd55b-f667-4407-844a-095044ee3b9c', '09eb99c2-0b03-4fa8-9924-c509caba459d'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0dcead6a-0806-4ad3-b09a-cf2276bea266 tempest-VolumeDependencyTests-1557140602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0dcead6a-0806-4ad3-b09a-cf2276bea266 tempest-VolumeDependencyTests-1557140602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0dcead6a-0806-4ad3-b09a-cf2276bea266 tempest-VolumeDependencyTests-1557140602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:35 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0dcead6a-0806-4ad3-b09a-cf2276bea266 tempest-VolumeDependencyTests-1557140602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0dcead6a-0806-4ad3-b09a-cf2276bea266 tempest-VolumeDependencyTests-1557140602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0dcead6a-0806-4ad3-b09a-cf2276bea266 tempest-VolumeDependencyTests-1557140602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:36 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-48a4978f-b6c9-4515-9825-76e3b415116e tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.0e343f65-ca78-4a70-974a-9c42f5a91a6e" returned: 0 in 0.369s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:36 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:45:36 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Flow 'volume_create_manager' (ad9d3499-aaa9-4e9f-9260-8b5e9921f8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699e68fd-ec3e-4d7f-b6c2-4b4ac0065159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-17eef620-38f2-496d-ae92-4e22104982f9 tempest-VolumeDependencyTests-1557140602 None] Acquiring lock "cinder-b29cc19e-1cd5-41a9-a9d8-36565f9a859b-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699e68fd-ec3e-4d7f-b6c2-4b4ac0065159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-366702364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24abc6ca-15fd-4cb8-a241-e778543509e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2196361ea84e4634b391f8e50aec88e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:36Z,use_quota=True,user_id='1877228a1c4f49c9927b3d5e2b82d912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468e8fd5-9acc-4333-a30c-8620cb71965f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468e8fd5-9acc-4333-a30c-8620cb71965f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e623e2b-0108-4ce1-a8f5-a6c181acde4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e623e2b-0108-4ce1-a8f5-a6c181acde4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24abc6ca-15fd-4cb8-a241-e778543509e6', 'volume_name': 'volume-24abc6ca-15fd-4cb8-a241-e778543509e6', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c042fb-e3e4-46ff-8528-6764f17ac071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c042fb-e3e4-46ff-8528-6764f17ac071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c58f5d0-9277-462f-a264-201fca24e502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:36 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Volume 24abc6ca-15fd-4cb8-a241-e778543509e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24abc6ca-15fd-4cb8-a241-e778543509e6', 'volume_size': 1} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-48a4978f-b6c9-4515-9825-76e3b415116e tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-17eef620-38f2-496d-ae92-4e22104982f9 tempest-VolumeDependencyTests-1557140602 None] Lock "cinder-b29cc19e-1cd5-41a9-a9d8-36565f9a859b-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:36 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.info Nov 03 07:45:36 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-17eef620-38f2-496d-ae92-4e22104982f9 tempest-VolumeDependencyTests-1557140602 None] Acquiring lock "cinder-quobyte-b29cc19e-1cd5-41a9-a9d8-36565f9a859b" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-17eef620-38f2-496d-ae92-4e22104982f9 tempest-VolumeDependencyTests-1557140602 None] Lock "cinder-quobyte-b29cc19e-1cd5-41a9-a9d8-36565f9a859b" acquired by "delete_volume" :: waited 0.019s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[742d67a2-f5e1-4019-a242-70c4c7a30082]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17eef620-38f2-496d-ae92-4e22104982f9 tempest-VolumeDependencyTests-1557140602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b29cc19e-1cd5-41a9-a9d8-36565f9a859b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:36 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0dcead6a-0806-4ad3-b09a-cf2276bea266 tempest-VolumeDependencyTests-1557140602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.388s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-0dcead6a-0806-4ad3-b09a-cf2276bea266 tempest-VolumeDependencyTests-1557140602 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:36 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-0dcead6a-0806-4ad3-b09a-cf2276bea266 tempest-VolumeDependencyTests-1557140602 None] Deleted volume successfully. Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0dcead6a-0806-4ad3-b09a-cf2276bea266 tempest-VolumeDependencyTests-1557140602 None] Lock "cinder-0f3586f6-4ff0-48d0-be45-5f5083106bbf-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:36 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b29cc19e-1cd5-41a9-a9d8-36565f9a859b Nov 03 07:45:36 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Flow 'volume_create_manager' (8980a189-04ff-4d14-9c94-7fd2e7fd50ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:36 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ffc62c-4179-45d0-954e-b091f98bcf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-48a4978f-b6c9-4515-9825-76e3b415116e tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.info" returned: 0 in 0.390s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:36 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-48a4978f-b6c9-4515-9825-76e3b415116e tempest-CreateVolumesFromSnapshotTest-1376318347 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.info is being set with open permissions: ugo+rw Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-48a4978f-b6c9-4515-9825-76e3b415116e tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ffc62c-4179-45d0-954e-b091f98bcf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2105980487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896046ce-5fa6-4a0c-937e-b2aaadbc2202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2196361ea84e4634b391f8e50aec88e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:36Z,use_quota=True,user_id='1877228a1c4f49c9927b3d5e2b82d912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:36 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.info Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac6066c-63c6-48fc-8ed2-3c9101130f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:36 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac6066c-63c6-48fc-8ed2-3c9101130f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (647a2f6b-2de7-4eea-aba3-bf9250e98157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (647a2f6b-2de7-4eea-aba3-bf9250e98157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '896046ce-5fa6-4a0c-937e-b2aaadbc2202', 'volume_name': 'volume-896046ce-5fa6-4a0c-937e-b2aaadbc2202', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891d6349-2685-46e3-a1ab-9e03134e3f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891d6349-2685-46e3-a1ab-9e03134e3f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0634b8-fc0d-42e3-82a5-50325910e33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:36 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Volume 896046ce-5fa6-4a0c-937e-b2aaadbc2202: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-896046ce-5fa6-4a0c-937e-b2aaadbc2202', 'volume_size': 1} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:36 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17eef620-38f2-496d-ae92-4e22104982f9 tempest-VolumeDependencyTests-1557140602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b29cc19e-1cd5-41a9-a9d8-36565f9a859b" returned: 0 in 0.501s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17eef620-38f2-496d-ae92-4e22104982f9 tempest-VolumeDependencyTests-1557140602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b29cc19e-1cd5-41a9-a9d8-36565f9a859b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:36 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b29cc19e-1cd5-41a9-a9d8-36565f9a859b Nov 03 07:45:36 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:36 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-48a4978f-b6c9-4515-9825-76e3b415116e tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.info" returned: 0 in 0.327s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-48a4978f-b6c9-4515-9825-76e3b415116e tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.499s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.339s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1403683095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6bf3fb-cff4-4ebf-b695-992ee409a0e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed98c25bc1c64da3a0227cf8c7bef103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:34Z,use_quota=True,user_id='3b3ce7b9c2864a2db5285861bf4701c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Creating volume 8a6bf3fb-cff4-4ebf-b695-992ee409a0e6 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:36 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:45:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:37 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6 1073741824 Nov 03 07:45:37 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:37 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-48a4978f-b6c9-4515-9825-76e3b415116e tempest-CreateVolumesFromSnapshotTest-1376318347 None] Create snapshot completed successfully Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Flow 'volume_create_manager' (f06e52e8-5fb8-4fa3-be76-d81771d9658a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d6dc55-fed0-40dd-95cf-a82945ee78c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d6dc55-fed0-40dd-95cf-a82945ee78c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1662582634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed56b19d-4645-4de1-83fe-c0d88d48c80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2196361ea84e4634b391f8e50aec88e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:37Z,use_quota=True,user_id='1877228a1c4f49c9927b3d5e2b82d912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7adb02ad-fcc7-48c9-ae9c-5e364cdfef7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7adb02ad-fcc7-48c9-ae9c-5e364cdfef7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa79401-6ce7-487d-850a-70794ec53a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa79401-6ce7-487d-850a-70794ec53a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed56b19d-4645-4de1-83fe-c0d88d48c80e', 'volume_name': 'volume-ed56b19d-4645-4de1-83fe-c0d88d48c80e', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e021cf-52b0-49f4-aacb-9dd5f6f35eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e021cf-52b0-49f4-aacb-9dd5f6f35eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:37 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6daa1124-74a2-43b8-b1ef-77f418390037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:37 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Volume ed56b19d-4645-4de1-83fe-c0d88d48c80e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed56b19d-4645-4de1-83fe-c0d88d48c80e', 'volume_size': 1} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17eef620-38f2-496d-ae92-4e22104982f9 tempest-VolumeDependencyTests-1557140602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b29cc19e-1cd5-41a9-a9d8-36565f9a859b" returned: 0 in 0.334s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-17eef620-38f2-496d-ae92-4e22104982f9 tempest-VolumeDependencyTests-1557140602 None] Lock "cinder-quobyte-b29cc19e-1cd5-41a9-a9d8-36565f9a859b" released by "delete_volume" :: held 0.896s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-17eef620-38f2-496d-ae92-4e22104982f9 tempest-VolumeDependencyTests-1557140602 None] Created reservations ['3bfa9395-5332-4cb4-8e62-4e89e553eb7d', '7ac48c6f-a7f8-4658-9ff1-fa544e84f342', '94acab52-fb93-4883-877f-f9f9a1aee92e', '91706c1c-7bdb-4638-b2d6-c34638c36606'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-17eef620-38f2-496d-ae92-4e22104982f9 tempest-VolumeDependencyTests-1557140602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-17eef620-38f2-496d-ae92-4e22104982f9 tempest-VolumeDependencyTests-1557140602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-17eef620-38f2-496d-ae92-4e22104982f9 tempest-VolumeDependencyTests-1557140602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-17eef620-38f2-496d-ae92-4e22104982f9 tempest-VolumeDependencyTests-1557140602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-17eef620-38f2-496d-ae92-4e22104982f9 tempest-VolumeDependencyTests-1557140602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17eef620-38f2-496d-ae92-4e22104982f9 tempest-VolumeDependencyTests-1557140602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:37 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:45:37 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Flow 'volume_create_manager' (90f022f9-727b-405b-b759-a29d2ac949e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b16c41-3b39-48e1-a3c2-a2d59cc80897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b16c41-3b39-48e1-a3c2-a2d59cc80897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-410454669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f05de40-9158-4bf8-87c9-8f873843f0aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2196361ea84e4634b391f8e50aec88e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:37Z,use_quota=True,user_id='1877228a1c4f49c9927b3d5e2b82d912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89710dfb-acb9-4ab6-b272-1ef39cfa2207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89710dfb-acb9-4ab6-b272-1ef39cfa2207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6231cd6-4fd5-4da6-954b-f1964a6a6edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6231cd6-4fd5-4da6-954b-f1964a6a6edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f05de40-9158-4bf8-87c9-8f873843f0aa', 'volume_name': 'volume-5f05de40-9158-4bf8-87c9-8f873843f0aa', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c827aa5-995e-49cd-ba93-117d7411a034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c827aa5-995e-49cd-ba93-117d7411a034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7035e93d-d690-49a8-b3c7-fcb07fe7f348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:37 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:37 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Volume 5f05de40-9158-4bf8-87c9-8f873843f0aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f05de40-9158-4bf8-87c9-8f873843f0aa', 'volume_size': 1} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6 1073741824" returned: 0 in 0.683s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:37 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-17eef620-38f2-496d-ae92-4e22104982f9 tempest-VolumeDependencyTests-1557140602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.352s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-17eef620-38f2-496d-ae92-4e22104982f9 tempest-VolumeDependencyTests-1557140602 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:37 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-17eef620-38f2-496d-ae92-4e22104982f9 tempest-VolumeDependencyTests-1557140602 None] Deleted volume successfully. Nov 03 07:45:37 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6 Nov 03 07:45:37 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-17eef620-38f2-496d-ae92-4e22104982f9 tempest-VolumeDependencyTests-1557140602 None] Lock "cinder-b29cc19e-1cd5-41a9-a9d8-36565f9a859b-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Flow 'volume_create_manager' (9baa3b4b-4801-4746-bcbd-533665d787b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf756b21-4dee-42f7-a7f4-bf99e2de93f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf756b21-4dee-42f7-a7f4-bf99e2de93f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1611114855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5c8de2-e610-482b-8677-f238cebeec83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2196361ea84e4634b391f8e50aec88e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:38Z,use_quota=True,user_id='1877228a1c4f49c9927b3d5e2b82d912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baee232a-aa44-4f86-b13f-268f48f12a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baee232a-aa44-4f86-b13f-268f48f12a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2329e566-e900-482f-92e6-02524dd3a227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2329e566-e900-482f-92e6-02524dd3a227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa5c8de2-e610-482b-8677-f238cebeec83', 'volume_name': 'volume-fa5c8de2-e610-482b-8677-f238cebeec83', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a142a9-dccb-4d7e-bfe7-85e0d7b7e901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a142a9-dccb-4d7e-bfe7-85e0d7b7e901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22010c9f-107b-431c-98eb-14d367043996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:38 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Volume fa5c8de2-e610-482b-8677-f238cebeec83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa5c8de2-e610-482b-8677-f238cebeec83', 'volume_size': 1} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:38 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6" returned: 0 in 0.292s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.828s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-366702364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24abc6ca-15fd-4cb8-a241-e778543509e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2196361ea84e4634b391f8e50aec88e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:36Z,use_quota=True,user_id='1877228a1c4f49c9927b3d5e2b82d912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Creating volume 24abc6ca-15fd-4cb8-a241-e778543509e6 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:38 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-24abc6ca-15fd-4cb8-a241-e778543509e6 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd0926d-54e7-4c06-be14-f694870bde4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:38 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-24abc6ca-15fd-4cb8-a241-e778543509e6 1073741824 Nov 03 07:45:38 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd27169a-0d19-4565-ada5-ae26504570ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:38 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Volume volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6 (8a6bf3fb-cff4-4ebf-b695-992ee409a0e6): created successfully Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd27169a-0d19-4565-ada5-ae26504570ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Flow 'volume_create_manager' (6ba2cc0d-bb5c-4b3a-b5bc-d8206d2ef55d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:38 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-4a350f36-9602-478b-b330-8bcc60a42463 tempest-ProjectMemberTests-2017513802 None] Created volume successfully. Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Flow 'volume_create_manager' (6bb7a2db-ee7c-411e-bf99-85e2c75a7be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb3edf2-126f-481a-89f9-73f5b033dc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb3edf2-126f-481a-89f9-73f5b033dc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1878833745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7994334b-8dd4-4184-b0aa-83393ae83f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c848ad093948bb8b3826bd9c13ff44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:38Z,use_quota=True,user_id='5886febc1aa44772bf1096dade659b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e9573a-9613-453d-a68f-004ebda5c376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e9573a-9613-453d-a68f-004ebda5c376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:38 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16bd5015-ea7e-4d73-b6f9-ed6f29909ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16bd5015-ea7e-4d73-b6f9-ed6f29909ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7994334b-8dd4-4184-b0aa-83393ae83f62', 'volume_name': 'volume-7994334b-8dd4-4184-b0aa-83393ae83f62', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade600f0-9b4d-4b86-9d5f-3c74d40200d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade600f0-9b4d-4b86-9d5f-3c74d40200d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d91046-2d25-49be-8dd1-ef90fcd240e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:38 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Volume 7994334b-8dd4-4184-b0aa-83393ae83f62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7994334b-8dd4-4184-b0aa-83393ae83f62', 'volume_size': 1} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-24abc6ca-15fd-4cb8-a241-e778543509e6 1073741824" returned: 0 in 0.608s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-24abc6ca-15fd-4cb8-a241-e778543509e6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:38 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-24abc6ca-15fd-4cb8-a241-e778543509e6 Nov 03 07:45:38 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Flow 'volume_create_manager' (1a536c48-cb31-4c3d-a52e-bf781e8ed76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:39 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd42cf1d-f196-4764-86cd-0addc36ef82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-24abc6ca-15fd-4cb8-a241-e778543509e6" returned: 0 in 0.429s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.444s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2105980487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896046ce-5fa6-4a0c-937e-b2aaadbc2202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2196361ea84e4634b391f8e50aec88e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:36Z,use_quota=True,user_id='1877228a1c4f49c9927b3d5e2b82d912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Creating volume 896046ce-5fa6-4a0c-937e-b2aaadbc2202 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:39 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-896046ce-5fa6-4a0c-937e-b2aaadbc2202 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:39 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-896046ce-5fa6-4a0c-937e-b2aaadbc2202 1073741824 Nov 03 07:45:39 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd42cf1d-f196-4764-86cd-0addc36ef82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-921389775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8dfec34-2c9e-40a6-8110-8a24adfcb2e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c848ad093948bb8b3826bd9c13ff44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:39Z,use_quota=True,user_id='5886febc1aa44772bf1096dade659b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c14e57-2ec9-4481-ab08-961e289ae961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c14e57-2ec9-4481-ab08-961e289ae961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb69eb09-ddaa-4671-ada0-c317aa553a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb69eb09-ddaa-4671-ada0-c317aa553a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8dfec34-2c9e-40a6-8110-8a24adfcb2e7', 'volume_name': 'volume-c8dfec34-2c9e-40a6-8110-8a24adfcb2e7', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a50e1cb-b2a9-4d0d-89aa-57c902f81b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a50e1cb-b2a9-4d0d-89aa-57c902f81b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e03768-e3e4-4ca2-9dbf-2cc013cdc785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:39 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Volume c8dfec34-2c9e-40a6-8110-8a24adfcb2e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8dfec34-2c9e-40a6-8110-8a24adfcb2e7', 'volume_size': 1} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c58f5d0-9277-462f-a264-201fca24e502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24abc6ca-15fd-4cb8-a241-e778543509e6', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31b0f59-a5eb-48ec-86c3-0642846a1033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:39 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Volume volume-24abc6ca-15fd-4cb8-a241-e778543509e6 (24abc6ca-15fd-4cb8-a241-e778543509e6): created successfully Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31b0f59-a5eb-48ec-86c3-0642846a1033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Flow 'volume_create_manager' (ad9d3499-aaa9-4e9f-9260-8b5e9921f8e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:39 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-02809e0a-1f49-4fdb-868a-1fe16b0488dd tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Created volume successfully. Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b6ff957a-99ed-4dc5-80a4-10f34fbd9fbf tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:39 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-896046ce-5fa6-4a0c-937e-b2aaadbc2202 1073741824" returned: 0 in 0.668s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-896046ce-5fa6-4a0c-937e-b2aaadbc2202 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:39 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-896046ce-5fa6-4a0c-937e-b2aaadbc2202 Nov 03 07:45:39 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Flow 'volume_create_manager' (591a8703-d93e-4d82-b785-5cacd15581f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff47eaae-d369-4bf4-b5a8-34d1d172e0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff47eaae-d369-4bf4-b5a8-34d1d172e0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-622956416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d5ce86-15a5-40d0-a254-f3d97afe5d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c848ad093948bb8b3826bd9c13ff44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:40Z,use_quota=True,user_id='5886febc1aa44772bf1096dade659b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a45eeb-ac1b-433a-b01c-5eb855d44fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a45eeb-ac1b-433a-b01c-5eb855d44fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f16041-a8dc-49b1-98f5-811fa297a3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f16041-a8dc-49b1-98f5-811fa297a3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1d5ce86-15a5-40d0-a254-f3d97afe5d90', 'volume_name': 'volume-c1d5ce86-15a5-40d0-a254-f3d97afe5d90', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (597f5d36-8c0e-4923-b2a1-f12c37cb8e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (597f5d36-8c0e-4923-b2a1-f12c37cb8e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:39 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d596bc78-60f5-42a9-a61d-0f318d1b6981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:40 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Volume c1d5ce86-15a5-40d0-a254-f3d97afe5d90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1d5ce86-15a5-40d0-a254-f3d97afe5d90', 'volume_size': 1} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Flow 'volume_create_manager' (f4c67fa7-7d71-4b4b-b812-1ef7987a20c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:40 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c418aeae-0c39-4738-b371-0c5f0e139955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-896046ce-5fa6-4a0c-937e-b2aaadbc2202" returned: 0 in 0.402s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.088s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1662582634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed56b19d-4645-4de1-83fe-c0d88d48c80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2196361ea84e4634b391f8e50aec88e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:37Z,use_quota=True,user_id='1877228a1c4f49c9927b3d5e2b82d912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Creating volume ed56b19d-4645-4de1-83fe-c0d88d48c80e {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:40 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed56b19d-4645-4de1-83fe-c0d88d48c80e 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c418aeae-0c39-4738-b371-0c5f0e139955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-552502384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c17f2544-eb32-4d6a-a420-468e73b1e21e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c848ad093948bb8b3826bd9c13ff44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:40Z,use_quota=True,user_id='5886febc1aa44772bf1096dade659b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5780d014-cf79-4307-98b5-0d0a066109a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:40 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed56b19d-4645-4de1-83fe-c0d88d48c80e 1073741824 Nov 03 07:45:40 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5780d014-cf79-4307-98b5-0d0a066109a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd1db2c-321f-4aad-9cbb-afbb361322fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd1db2c-321f-4aad-9cbb-afbb361322fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c17f2544-eb32-4d6a-a420-468e73b1e21e', 'volume_name': 'volume-c17f2544-eb32-4d6a-a420-468e73b1e21e', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3888832b-c5d8-4fbb-97b6-13141ac3efe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3888832b-c5d8-4fbb-97b6-13141ac3efe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce52e1df-4e0f-4341-9725-2267c69988ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:40 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Volume c17f2544-eb32-4d6a-a420-468e73b1e21e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c17f2544-eb32-4d6a-a420-468e73b1e21e', 'volume_size': 1} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0634b8-fc0d-42e3-82a5-50325910e33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-896046ce-5fa6-4a0c-937e-b2aaadbc2202', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5be32e-0beb-484b-83df-297c82d52aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:40 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Volume volume-896046ce-5fa6-4a0c-937e-b2aaadbc2202 (896046ce-5fa6-4a0c-937e-b2aaadbc2202): created successfully Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5be32e-0beb-484b-83df-297c82d52aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Flow 'volume_create_manager' (8980a189-04ff-4d14-9c94-7fd2e7fd50ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:40 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a8e3bad1-2af3-44c0-a197-731475a2ba05 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Created volume successfully. Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Flow 'volume_create_manager' (d8e1e4d9-72a2-4b2f-8927-6db90503853d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f2144f-1dce-47af-8c92-b76fd11a1920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f2144f-1dce-47af-8c92-b76fd11a1920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-4668081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72bb74ce-960d-43cc-9843-fdb46c7e1610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c848ad093948bb8b3826bd9c13ff44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:41Z,use_quota=True,user_id='5886febc1aa44772bf1096dade659b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93d4bce-3f6e-4b50-b92d-8b18a79407b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93d4bce-3f6e-4b50-b92d-8b18a79407b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ad1e51-07e9-461d-afeb-7115497d78e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ad1e51-07e9-461d-afeb-7115497d78e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72bb74ce-960d-43cc-9843-fdb46c7e1610', 'volume_name': 'volume-72bb74ce-960d-43cc-9843-fdb46c7e1610', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df6ebbd9-c394-48f8-94ad-65134d516e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df6ebbd9-c394-48f8-94ad-65134d516e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a24bfe1f-faa9-487e-b870-9d422d385220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:40 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Volume 72bb74ce-960d-43cc-9843-fdb46c7e1610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72bb74ce-960d-43cc-9843-fdb46c7e1610', 'volume_size': 1} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:40 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed56b19d-4645-4de1-83fe-c0d88d48c80e 1073741824" returned: 0 in 0.633s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed56b19d-4645-4de1-83fe-c0d88d48c80e {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:40 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed56b19d-4645-4de1-83fe-c0d88d48c80e Nov 03 07:45:41 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:41 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed56b19d-4645-4de1-83fe-c0d88d48c80e" returned: 0 in 0.287s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:41 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:45:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.599s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:41 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-410454669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f05de40-9158-4bf8-87c9-8f873843f0aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2196361ea84e4634b391f8e50aec88e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:37Z,use_quota=True,user_id='1877228a1c4f49c9927b3d5e2b82d912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:45:41 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Creating volume 5f05de40-9158-4bf8-87c9-8f873843f0aa {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:41 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:41 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:41 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:41 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:45:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5f05de40-9158-4bf8-87c9-8f873843f0aa 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6daa1124-74a2-43b8-b1ef-77f418390037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed56b19d-4645-4de1-83fe-c0d88d48c80e', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:41 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5f05de40-9158-4bf8-87c9-8f873843f0aa 1073741824 Nov 03 07:45:41 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015128ec-91b0-40e5-a892-ff72078916b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:41 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Volume volume-ed56b19d-4645-4de1-83fe-c0d88d48c80e (ed56b19d-4645-4de1-83fe-c0d88d48c80e): created successfully Nov 03 07:45:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015128ec-91b0-40e5-a892-ff72078916b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:41 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Flow 'volume_create_manager' (f06e52e8-5fb8-4fa3-be76-d81771d9658a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:41 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-57485d0b-48c8-4f0c-ae9d-959ec321ba7e tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Created volume successfully. Nov 03 07:45:41 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5f05de40-9158-4bf8-87c9-8f873843f0aa 1073741824" returned: 0 in 0.512s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5f05de40-9158-4bf8-87c9-8f873843f0aa {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:41 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5f05de40-9158-4bf8-87c9-8f873843f0aa Nov 03 07:45:41 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:42 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5f05de40-9158-4bf8-87c9-8f873843f0aa" returned: 0 in 0.241s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.066s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1611114855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5c8de2-e610-482b-8677-f238cebeec83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2196361ea84e4634b391f8e50aec88e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:38Z,use_quota=True,user_id='1877228a1c4f49c9927b3d5e2b82d912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Creating volume fa5c8de2-e610-482b-8677-f238cebeec83 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:42 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa5c8de2-e610-482b-8677-f238cebeec83 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7035e93d-d690-49a8-b3c7-fcb07fe7f348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f05de40-9158-4bf8-87c9-8f873843f0aa', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c13e492f-816f-4116-afb4-1779ae3152ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:42 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa5c8de2-e610-482b-8677-f238cebeec83 1073741824 Nov 03 07:45:42 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:42 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Volume volume-5f05de40-9158-4bf8-87c9-8f873843f0aa (5f05de40-9158-4bf8-87c9-8f873843f0aa): created successfully Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c13e492f-816f-4116-afb4-1779ae3152ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Flow 'volume_create_manager' (90f022f9-727b-405b-b759-a29d2ac949e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:42 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-3baf63b3-759b-42f1-9e0b-e11af98d273a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Created volume successfully. Nov 03 07:45:42 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa5c8de2-e610-482b-8677-f238cebeec83 1073741824" returned: 0 in 0.487s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa5c8de2-e610-482b-8677-f238cebeec83 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:42 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa5c8de2-e610-482b-8677-f238cebeec83 Nov 03 07:45:42 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:42 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa5c8de2-e610-482b-8677-f238cebeec83" returned: 0 in 0.263s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.243s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1878833745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7994334b-8dd4-4184-b0aa-83393ae83f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c848ad093948bb8b3826bd9c13ff44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:38Z,use_quota=True,user_id='5886febc1aa44772bf1096dade659b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Creating volume 7994334b-8dd4-4184-b0aa-83393ae83f62 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:42 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7994334b-8dd4-4184-b0aa-83393ae83f62 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22010c9f-107b-431c-98eb-14d367043996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa5c8de2-e610-482b-8677-f238cebeec83', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:42 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7994334b-8dd4-4184-b0aa-83393ae83f62 1073741824 Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b577bd-5450-4f50-a9b7-5eed996e04bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:42 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:42 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Volume volume-fa5c8de2-e610-482b-8677-f238cebeec83 (fa5c8de2-e610-482b-8677-f238cebeec83): created successfully Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b577bd-5450-4f50-a9b7-5eed996e04bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Flow 'volume_create_manager' (9baa3b4b-4801-4746-bcbd-533665d787b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:42 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b5b1e9cf-adb4-4a39-8564-bea1b033cde3 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Created volume successfully. Nov 03 07:45:43 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7994334b-8dd4-4184-b0aa-83393ae83f62 1073741824" returned: 0 in 0.488s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7994334b-8dd4-4184-b0aa-83393ae83f62 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:43 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7994334b-8dd4-4184-b0aa-83393ae83f62 Nov 03 07:45:43 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:43 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7994334b-8dd4-4184-b0aa-83393ae83f62" returned: 0 in 0.248s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:43 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:45:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.412s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:43 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-921389775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8dfec34-2c9e-40a6-8110-8a24adfcb2e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c848ad093948bb8b3826bd9c13ff44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:39Z,use_quota=True,user_id='5886febc1aa44772bf1096dade659b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:45:43 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Creating volume c8dfec34-2c9e-40a6-8110-8a24adfcb2e7 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:43 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:43 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:43 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:43 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:45:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c8dfec34-2c9e-40a6-8110-8a24adfcb2e7 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d91046-2d25-49be-8dd1-ef90fcd240e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7994334b-8dd4-4184-b0aa-83393ae83f62', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827a297f-353b-427d-8e81-7ecb5b4063db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:43 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c8dfec34-2c9e-40a6-8110-8a24adfcb2e7 1073741824 Nov 03 07:45:43 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:43 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Volume volume-7994334b-8dd4-4184-b0aa-83393ae83f62 (7994334b-8dd4-4184-b0aa-83393ae83f62): created successfully Nov 03 07:45:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827a297f-353b-427d-8e81-7ecb5b4063db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:43 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Flow 'volume_create_manager' (6bb7a2db-ee7c-411e-bf99-85e2c75a7be8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:43 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-84ab6dc2-0583-461f-a7af-9f906168a2cc tempest-CreateVolumesFromSnapshotTest-1376318347 None] Created volume successfully. Nov 03 07:45:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c5c4a65d-63cd-4fb9-bf22-e8e685aaa6d6 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "cinder-fa5c8de2-e610-482b-8677-f238cebeec83-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c5c4a65d-63cd-4fb9-bf22-e8e685aaa6d6 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-fa5c8de2-e610-482b-8677-f238cebeec83-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c5c4a65d-63cd-4fb9-bf22-e8e685aaa6d6 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "cinder-quobyte-fa5c8de2-e610-482b-8677-f238cebeec83" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c5c4a65d-63cd-4fb9-bf22-e8e685aaa6d6 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-quobyte-fa5c8de2-e610-482b-8677-f238cebeec83" acquired by "delete_volume" :: waited 0.019s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:44 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee93e81-f6f6-48f6-9482-cf702c3f263e]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c5c4a65d-63cd-4fb9-bf22-e8e685aaa6d6 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa5c8de2-e610-482b-8677-f238cebeec83 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:44 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c8dfec34-2c9e-40a6-8110-8a24adfcb2e7 1073741824" returned: 0 in 0.557s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c8dfec34-2c9e-40a6-8110-8a24adfcb2e7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:44 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c8dfec34-2c9e-40a6-8110-8a24adfcb2e7 Nov 03 07:45:44 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:44 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa5c8de2-e610-482b-8677-f238cebeec83 Nov 03 07:45:44 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:44 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c8dfec34-2c9e-40a6-8110-8a24adfcb2e7" returned: 0 in 0.266s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:45:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b6ff957a-99ed-4dc5-80a4-10f34fbd9fbf tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.960s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e03768-e3e4-4ca2-9dbf-2cc013cdc785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8dfec34-2c9e-40a6-8110-8a24adfcb2e7', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f886cfbd-2a62-4262-a797-9db8caa6a000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:44 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-b6ff957a-99ed-4dc5-80a4-10f34fbd9fbf tempest-ProjectMemberTests-2017513802 None] Creating offline snapshot 9b05d672-e9d7-4d13-bd05-119e4c4d3e70 of volume 8a6bf3fb-cff4-4ebf-b695-992ee409a0e6 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:45:44 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Volume volume-c8dfec34-2c9e-40a6-8110-8a24adfcb2e7 (c8dfec34-2c9e-40a6-8110-8a24adfcb2e7): created successfully Nov 03 07:45:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f886cfbd-2a62-4262-a797-9db8caa6a000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:44 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Flow 'volume_create_manager' (1a536c48-cb31-4c3d-a52e-bf781e8ed76d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:44 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[624f0484-f07b-4c15-843a-a97e4d306dd6]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b6ff957a-99ed-4dc5-80a4-10f34fbd9fbf tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:44 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c5c4a65d-63cd-4fb9-bf22-e8e685aaa6d6 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa5c8de2-e610-482b-8677-f238cebeec83" returned: 0 in 0.444s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c5c4a65d-63cd-4fb9-bf22-e8e685aaa6d6 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa5c8de2-e610-482b-8677-f238cebeec83 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:44 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-5c9d349b-09c6-40f7-a842-84732c75b81f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Created volume successfully. Nov 03 07:45:44 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa5c8de2-e610-482b-8677-f238cebeec83 Nov 03 07:45:44 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:44 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6 Nov 03 07:45:44 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:44 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c5c4a65d-63cd-4fb9-bf22-e8e685aaa6d6 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-fa5c8de2-e610-482b-8677-f238cebeec83" returned: 0 in 0.294s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c5c4a65d-63cd-4fb9-bf22-e8e685aaa6d6 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-quobyte-fa5c8de2-e610-482b-8677-f238cebeec83" released by "delete_volume" :: held 0.795s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-c5c4a65d-63cd-4fb9-bf22-e8e685aaa6d6 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Created reservations ['1e57c1b5-6a27-45ea-8798-08e5e9f5437d', '932f4468-dc53-4fd3-ba8e-372431bfd262', '3d3b5e06-ed3b-4241-9309-740310e9d705', '8c05fa20-7361-4efd-905c-52f1c560a939'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:45 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b6ff957a-99ed-4dc5-80a4-10f34fbd9fbf tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6" returned: 0 in 0.435s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b6ff957a-99ed-4dc5-80a4-10f34fbd9fbf tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.9b05d672-e9d7-4d13-bd05-119e4c4d3e70 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:45 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.9b05d672-e9d7-4d13-bd05-119e4c4d3e70 1G Nov 03 07:45:45 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c5c4a65d-63cd-4fb9-bf22-e8e685aaa6d6 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c5c4a65d-63cd-4fb9-bf22-e8e685aaa6d6 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-c5c4a65d-63cd-4fb9-bf22-e8e685aaa6d6 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-c5c4a65d-63cd-4fb9-bf22-e8e685aaa6d6 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c5c4a65d-63cd-4fb9-bf22-e8e685aaa6d6 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c5c4a65d-63cd-4fb9-bf22-e8e685aaa6d6 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:45 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:45:45 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-85cdd0ca-35a2-4592-b3d8-48896cc1e70f tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "cinder-5f05de40-9158-4bf8-87c9-8f873843f0aa-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-85cdd0ca-35a2-4592-b3d8-48896cc1e70f tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-5f05de40-9158-4bf8-87c9-8f873843f0aa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-85cdd0ca-35a2-4592-b3d8-48896cc1e70f tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "cinder-quobyte-5f05de40-9158-4bf8-87c9-8f873843f0aa" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-85cdd0ca-35a2-4592-b3d8-48896cc1e70f tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-quobyte-5f05de40-9158-4bf8-87c9-8f873843f0aa" acquired by "delete_volume" :: waited 0.027s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe49897-91d6-4a35-9e85-1fea630195b5]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-85cdd0ca-35a2-4592-b3d8-48896cc1e70f tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5f05de40-9158-4bf8-87c9-8f873843f0aa {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:45 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c5c4a65d-63cd-4fb9-bf22-e8e685aaa6d6 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.341s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-c5c4a65d-63cd-4fb9-bf22-e8e685aaa6d6 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:45 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-c5c4a65d-63cd-4fb9-bf22-e8e685aaa6d6 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Deleted volume successfully. Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c5c4a65d-63cd-4fb9-bf22-e8e685aaa6d6 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-fa5c8de2-e610-482b-8677-f238cebeec83-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:45 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5f05de40-9158-4bf8-87c9-8f873843f0aa Nov 03 07:45:45 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:45 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b6ff957a-99ed-4dc5-80a4-10f34fbd9fbf tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.9b05d672-e9d7-4d13-bd05-119e4c4d3e70 1G" returned: 0 in 0.577s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b6ff957a-99ed-4dc5-80a4-10f34fbd9fbf tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.9b05d672-e9d7-4d13-bd05-119e4c4d3e70 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:45 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.9b05d672-e9d7-4d13-bd05-119e4c4d3e70 Nov 03 07:45:45 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:45 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-85cdd0ca-35a2-4592-b3d8-48896cc1e70f tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5f05de40-9158-4bf8-87c9-8f873843f0aa" returned: 0 in 0.415s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-85cdd0ca-35a2-4592-b3d8-48896cc1e70f tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5f05de40-9158-4bf8-87c9-8f873843f0aa {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:45 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5f05de40-9158-4bf8-87c9-8f873843f0aa Nov 03 07:45:45 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:45 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b6ff957a-99ed-4dc5-80a4-10f34fbd9fbf tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.9b05d672-e9d7-4d13-bd05-119e4c4d3e70" returned: 0 in 0.313s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:45 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-b6ff957a-99ed-4dc5-80a4-10f34fbd9fbf tempest-ProjectMemberTests-2017513802 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.9b05d672-e9d7-4d13-bd05-119e4c4d3e70 is being set with open permissions: ugo+rw Nov 03 07:45:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b6ff957a-99ed-4dc5-80a4-10f34fbd9fbf tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.9b05d672-e9d7-4d13-bd05-119e4c4d3e70 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:46 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.9b05d672-e9d7-4d13-bd05-119e4c4d3e70 Nov 03 07:45:46 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:46 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-85cdd0ca-35a2-4592-b3d8-48896cc1e70f tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-5f05de40-9158-4bf8-87c9-8f873843f0aa" returned: 0 in 0.282s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-85cdd0ca-35a2-4592-b3d8-48896cc1e70f tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-quobyte-5f05de40-9158-4bf8-87c9-8f873843f0aa" released by "delete_volume" :: held 0.750s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:46 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b6ff957a-99ed-4dc5-80a4-10f34fbd9fbf tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.9b05d672-e9d7-4d13-bd05-119e4c4d3e70" returned: 0 in 0.288s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:46 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-85cdd0ca-35a2-4592-b3d8-48896cc1e70f tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Created reservations ['3ccaead7-0681-4917-8f53-67df8233bb40', '3f565d88-8b01-45c3-8643-274e69bd61b2', 'c32fb29e-5013-4ed4-82d5-0e52c82e2de6', '88d31fb4-5e5e-4dfc-93b1-a1f21e6ad7bb'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b6ff957a-99ed-4dc5-80a4-10f34fbd9fbf tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:46 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.info Nov 03 07:45:46 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-85cdd0ca-35a2-4592-b3d8-48896cc1e70f tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-85cdd0ca-35a2-4592-b3d8-48896cc1e70f tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-85cdd0ca-35a2-4592-b3d8-48896cc1e70f tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-85cdd0ca-35a2-4592-b3d8-48896cc1e70f tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-85cdd0ca-35a2-4592-b3d8-48896cc1e70f tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-85cdd0ca-35a2-4592-b3d8-48896cc1e70f tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:46 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:45:46 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b559cc1b-616a-4556-962e-d4c66b2ce1b8 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "cinder-ed56b19d-4645-4de1-83fe-c0d88d48c80e-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b559cc1b-616a-4556-962e-d4c66b2ce1b8 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-ed56b19d-4645-4de1-83fe-c0d88d48c80e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:46 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b6ff957a-99ed-4dc5-80a4-10f34fbd9fbf tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.info" returned: 0 in 0.318s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:46 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-b6ff957a-99ed-4dc5-80a4-10f34fbd9fbf tempest-ProjectMemberTests-2017513802 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.info is being set with open permissions: ugo+rw Nov 03 07:45:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b6ff957a-99ed-4dc5-80a4-10f34fbd9fbf tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:46 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.info Nov 03 07:45:46 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b559cc1b-616a-4556-962e-d4c66b2ce1b8 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "cinder-quobyte-ed56b19d-4645-4de1-83fe-c0d88d48c80e" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b559cc1b-616a-4556-962e-d4c66b2ce1b8 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-quobyte-ed56b19d-4645-4de1-83fe-c0d88d48c80e" acquired by "delete_volume" :: waited 0.025s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:46 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-85cdd0ca-35a2-4592-b3d8-48896cc1e70f tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.364s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:46 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-85cdd0ca-35a2-4592-b3d8-48896cc1e70f tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:46 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[619f096f-c07d-406f-aae1-1fb70188470f]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b559cc1b-616a-4556-962e-d4c66b2ce1b8 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed56b19d-4645-4de1-83fe-c0d88d48c80e {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:46 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-85cdd0ca-35a2-4592-b3d8-48896cc1e70f tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Deleted volume successfully. Nov 03 07:45:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-85cdd0ca-35a2-4592-b3d8-48896cc1e70f tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-5f05de40-9158-4bf8-87c9-8f873843f0aa-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:46 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed56b19d-4645-4de1-83fe-c0d88d48c80e Nov 03 07:45:46 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:46 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b6ff957a-99ed-4dc5-80a4-10f34fbd9fbf tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.info" returned: 0 in 0.351s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b6ff957a-99ed-4dc5-80a4-10f34fbd9fbf tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.457s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.019s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-622956416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d5ce86-15a5-40d0-a254-f3d97afe5d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c848ad093948bb8b3826bd9c13ff44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:40Z,use_quota=True,user_id='5886febc1aa44772bf1096dade659b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Creating volume c1d5ce86-15a5-40d0-a254-f3d97afe5d90 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:47 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1d5ce86-15a5-40d0-a254-f3d97afe5d90 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:47 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1d5ce86-15a5-40d0-a254-f3d97afe5d90 1073741824 Nov 03 07:45:47 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:47 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b6ff957a-99ed-4dc5-80a4-10f34fbd9fbf tempest-ProjectMemberTests-2017513802 None] Create snapshot completed successfully Nov 03 07:45:47 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b559cc1b-616a-4556-962e-d4c66b2ce1b8 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed56b19d-4645-4de1-83fe-c0d88d48c80e" returned: 0 in 0.462s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b559cc1b-616a-4556-962e-d4c66b2ce1b8 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed56b19d-4645-4de1-83fe-c0d88d48c80e {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:47 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed56b19d-4645-4de1-83fe-c0d88d48c80e Nov 03 07:45:47 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:47 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b559cc1b-616a-4556-962e-d4c66b2ce1b8 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-ed56b19d-4645-4de1-83fe-c0d88d48c80e" returned: 0 in 0.274s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b559cc1b-616a-4556-962e-d4c66b2ce1b8 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-quobyte-ed56b19d-4645-4de1-83fe-c0d88d48c80e" released by "delete_volume" :: held 0.790s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-b559cc1b-616a-4556-962e-d4c66b2ce1b8 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Created reservations ['7cf6a7e7-2d4b-4299-8b59-146c36b01abd', '5ac675be-f860-4492-9650-f66a44879302', 'ee50b40e-87c6-4a04-a420-f8c29d6f07e7', '0be299f4-213f-475d-ad67-5f10ba0cb20d'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:47 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1d5ce86-15a5-40d0-a254-f3d97afe5d90 1073741824" returned: 0 in 0.575s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1d5ce86-15a5-40d0-a254-f3d97afe5d90 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b559cc1b-616a-4556-962e-d4c66b2ce1b8 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b559cc1b-616a-4556-962e-d4c66b2ce1b8 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b559cc1b-616a-4556-962e-d4c66b2ce1b8 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b559cc1b-616a-4556-962e-d4c66b2ce1b8 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b559cc1b-616a-4556-962e-d4c66b2ce1b8 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b559cc1b-616a-4556-962e-d4c66b2ce1b8 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:47 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1d5ce86-15a5-40d0-a254-f3d97afe5d90 Nov 03 07:45:47 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:47 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:45:47 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3d50c2ff-35ce-4a68-8f6d-780b4df2b757 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-9b05d672-e9d7-4d13-bd05-119e4c4d3e70-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0c7dca48-25a2-4c19-a0b1-ca553bc0232c tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "cinder-896046ce-5fa6-4a0c-937e-b2aaadbc2202-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3d50c2ff-35ce-4a68-8f6d-780b4df2b757 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-9b05d672-e9d7-4d13-bd05-119e4c4d3e70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3d50c2ff-35ce-4a68-8f6d-780b4df2b757 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0c7dca48-25a2-4c19-a0b1-ca553bc0232c tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-896046ce-5fa6-4a0c-937e-b2aaadbc2202-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3d50c2ff-35ce-4a68-8f6d-780b4df2b757 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3d50c2ff-35ce-4a68-8f6d-780b4df2b757 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-9b05d672-e9d7-4d13-bd05-119e4c4d3e70" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3d50c2ff-35ce-4a68-8f6d-780b4df2b757 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-9b05d672-e9d7-4d13-bd05-119e4c4d3e70" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-3d50c2ff-35ce-4a68-8f6d-780b4df2b757 tempest-ProjectMemberTests-2017513802 None] Deleting offline snapshot 9b05d672-e9d7-4d13-bd05-119e4c4d3e70 of volume 8a6bf3fb-cff4-4ebf-b695-992ee409a0e6 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:45:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-3d50c2ff-35ce-4a68-8f6d-780b4df2b757 tempest-ProjectMemberTests-2017513802 None] snapshot_file for this snap is: volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.9b05d672-e9d7-4d13-bd05-119e4c4d3e70 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1338cb-a11e-4fc4-af31-b886d96a877d]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3d50c2ff-35ce-4a68-8f6d-780b4df2b757 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.9b05d672-e9d7-4d13-bd05-119e4c4d3e70 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0c7dca48-25a2-4c19-a0b1-ca553bc0232c tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "cinder-quobyte-896046ce-5fa6-4a0c-937e-b2aaadbc2202" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:48 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0c7dca48-25a2-4c19-a0b1-ca553bc0232c tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-quobyte-896046ce-5fa6-4a0c-937e-b2aaadbc2202" acquired by "delete_volume" :: waited 0.034s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1d5ce86-15a5-40d0-a254-f3d97afe5d90" returned: 0 in 0.441s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.727s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-552502384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c17f2544-eb32-4d6a-a420-468e73b1e21e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c848ad093948bb8b3826bd9c13ff44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:40Z,use_quota=True,user_id='5886febc1aa44772bf1096dade659b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Creating volume c17f2544-eb32-4d6a-a420-468e73b1e21e {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:48 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:48 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c17f2544-eb32-4d6a-a420-468e73b1e21e 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4578e4e-48f4-4779-ab67-6525634cf689]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0c7dca48-25a2-4c19-a0b1-ca553bc0232c tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-896046ce-5fa6-4a0c-937e-b2aaadbc2202 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:48 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c17f2544-eb32-4d6a-a420-468e73b1e21e 1073741824 Nov 03 07:45:48 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b559cc1b-616a-4556-962e-d4c66b2ce1b8 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.479s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-b559cc1b-616a-4556-962e-d4c66b2ce1b8 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:48 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b559cc1b-616a-4556-962e-d4c66b2ce1b8 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Deleted volume successfully. Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d596bc78-60f5-42a9-a61d-0f318d1b6981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1d5ce86-15a5-40d0-a254-f3d97afe5d90', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:48 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.9b05d672-e9d7-4d13-bd05-119e4c4d3e70 Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40243574-606b-4415-98a6-3f36da56a470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:48 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:48 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Volume volume-c1d5ce86-15a5-40d0-a254-f3d97afe5d90 (c1d5ce86-15a5-40d0-a254-f3d97afe5d90): created successfully Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40243574-606b-4415-98a6-3f36da56a470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Flow 'volume_create_manager' (591a8703-d93e-4d82-b785-5cacd15581f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b559cc1b-616a-4556-962e-d4c66b2ce1b8 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-ed56b19d-4645-4de1-83fe-c0d88d48c80e-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:48 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-77621cf5-1de3-4cb6-af77-a23c4191a946 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Created volume successfully. Nov 03 07:45:48 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-896046ce-5fa6-4a0c-937e-b2aaadbc2202 Nov 03 07:45:48 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:48 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3d50c2ff-35ce-4a68-8f6d-780b4df2b757 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.9b05d672-e9d7-4d13-bd05-119e4c4d3e70" returned: 0 in 0.550s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-3d50c2ff-35ce-4a68-8f6d-780b4df2b757 tempest-ProjectMemberTests-2017513802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0f992e-c70c-4c69-9b2e-abc80f70de83]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3d50c2ff-35ce-4a68-8f6d-780b4df2b757 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:48 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0c7dca48-25a2-4c19-a0b1-ca553bc0232c tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-896046ce-5fa6-4a0c-937e-b2aaadbc2202" returned: 0 in 0.581s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0c7dca48-25a2-4c19-a0b1-ca553bc0232c tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-896046ce-5fa6-4a0c-937e-b2aaadbc2202 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:48 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-896046ce-5fa6-4a0c-937e-b2aaadbc2202 Nov 03 07:45:48 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6 Nov 03 07:45:48 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:48 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:48 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c17f2544-eb32-4d6a-a420-468e73b1e21e 1073741824" returned: 0 in 0.655s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c17f2544-eb32-4d6a-a420-468e73b1e21e {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:48 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c17f2544-eb32-4d6a-a420-468e73b1e21e Nov 03 07:45:48 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:49 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0c7dca48-25a2-4c19-a0b1-ca553bc0232c tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-896046ce-5fa6-4a0c-937e-b2aaadbc2202" returned: 0 in 0.406s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:49 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3d50c2ff-35ce-4a68-8f6d-780b4df2b757 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6" returned: 0 in 0.558s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3d50c2ff-35ce-4a68-8f6d-780b4df2b757 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.9b05d672-e9d7-4d13-bd05-119e4c4d3e70 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:49 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0c7dca48-25a2-4c19-a0b1-ca553bc0232c tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-quobyte-896046ce-5fa6-4a0c-937e-b2aaadbc2202" released by "delete_volume" :: held 1.111s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c17f2544-eb32-4d6a-a420-468e73b1e21e" returned: 0 in 0.369s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.419s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-4668081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72bb74ce-960d-43cc-9843-fdb46c7e1610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c848ad093948bb8b3826bd9c13ff44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:41Z,use_quota=True,user_id='5886febc1aa44772bf1096dade659b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Creating volume 72bb74ce-960d-43cc-9843-fdb46c7e1610 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:49 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:45:49 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.9b05d672-e9d7-4d13-bd05-119e4c4d3e70 Nov 03 07:45:49 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:49 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:49 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-72bb74ce-960d-43cc-9843-fdb46c7e1610 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce52e1df-4e0f-4341-9725-2267c69988ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c17f2544-eb32-4d6a-a420-468e73b1e21e', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:49 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-72bb74ce-960d-43cc-9843-fdb46c7e1610 1073741824 Nov 03 07:45:49 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0914d328-fa34-42c1-b3b2-6ea01f81d52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:49 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Volume volume-c17f2544-eb32-4d6a-a420-468e73b1e21e (c17f2544-eb32-4d6a-a420-468e73b1e21e): created successfully Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0914d328-fa34-42c1-b3b2-6ea01f81d52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Flow 'volume_create_manager' (f4c67fa7-7d71-4b4b-b812-1ef7987a20c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:49 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a400920f-b19f-4d5f-bced-5a6a1c76e4e3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Created volume successfully. Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-0c7dca48-25a2-4c19-a0b1-ca553bc0232c tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Created reservations ['07a7f4cd-dffb-4088-9727-63733d0d83ac', '74421f90-6f2f-4bd6-88ff-3d23d3581d01', 'a358c819-e022-4b15-9875-8366cd5740f9', 'cee7f3ed-7908-4d06-b9e3-b3c188fdeba3'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0c7dca48-25a2-4c19-a0b1-ca553bc0232c tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0c7dca48-25a2-4c19-a0b1-ca553bc0232c tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0c7dca48-25a2-4c19-a0b1-ca553bc0232c tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0c7dca48-25a2-4c19-a0b1-ca553bc0232c tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0c7dca48-25a2-4c19-a0b1-ca553bc0232c tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0c7dca48-25a2-4c19-a0b1-ca553bc0232c tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:49 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:45:49 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:49 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.405s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 28 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:45:49 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3d50c2ff-35ce-4a68-8f6d-780b4df2b757 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.9b05d672-e9d7-4d13-bd05-119e4c4d3e70" returned: 0 in 0.562s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3d50c2ff-35ce-4a68-8f6d-780b4df2b757 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.9b05d672-e9d7-4d13-bd05-119e4c4d3e70 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:49 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.9b05d672-e9d7-4d13-bd05-119e4c4d3e70 Nov 03 07:45:49 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:49 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0c7dca48-25a2-4c19-a0b1-ca553bc0232c tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.348s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-0c7dca48-25a2-4c19-a0b1-ca553bc0232c tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:49 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-0c7dca48-25a2-4c19-a0b1-ca553bc0232c tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Deleted volume successfully. Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0c7dca48-25a2-4c19-a0b1-ca553bc0232c tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-896046ce-5fa6-4a0c-937e-b2aaadbc2202-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:49 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-72bb74ce-960d-43cc-9843-fdb46c7e1610 1073741824" returned: 0 in 0.700s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-72bb74ce-960d-43cc-9843-fdb46c7e1610 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:49 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-72bb74ce-960d-43cc-9843-fdb46c7e1610 Nov 03 07:45:49 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:50 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3d50c2ff-35ce-4a68-8f6d-780b4df2b757 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6.9b05d672-e9d7-4d13-bd05-119e4c4d3e70" returned: 0 in 0.317s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3d50c2ff-35ce-4a68-8f6d-780b4df2b757 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-9b05d672-e9d7-4d13-bd05-119e4c4d3e70" released by "_delete_snapshot" :: held 2.168s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3d50c2ff-35ce-4a68-8f6d-780b4df2b757 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6" released by "delete_snapshot" :: held 2.208s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:50 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-72bb74ce-960d-43cc-9843-fdb46c7e1610" returned: 0 in 0.310s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-3d50c2ff-35ce-4a68-8f6d-780b4df2b757 tempest-ProjectMemberTests-2017513802 None] Created reservations ['c0604426-e278-452d-869c-8a2f34c531b8', '5c8a69f1-84e2-453f-ad54-64a04b982594', '2f4540bc-75e8-45ed-8053-90188ab13d34', '7735e605-78b6-43ab-8699-b7386f7d472f'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a24bfe1f-faa9-487e-b870-9d422d385220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72bb74ce-960d-43cc-9843-fdb46c7e1610', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672e2a28-c7b6-4a49-a952-27454ac50f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:50 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Volume volume-72bb74ce-960d-43cc-9843-fdb46c7e1610 (72bb74ce-960d-43cc-9843-fdb46c7e1610): created successfully Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672e2a28-c7b6-4a49-a952-27454ac50f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Flow 'volume_create_manager' (d8e1e4d9-72a2-4b2f-8927-6db90503853d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ef95327c-7c54-4519-9d59-d03f44fc2205 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "cinder-24abc6ca-15fd-4cb8-a241-e778543509e6-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:50 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-2c5f4ebe-1745-4ceb-bae8-bb5588930c54 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Created volume successfully. Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ef95327c-7c54-4519-9d59-d03f44fc2205 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-24abc6ca-15fd-4cb8-a241-e778543509e6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:50 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-3d50c2ff-35ce-4a68-8f6d-780b4df2b757 tempest-ProjectMemberTests-2017513802 None] Delete snapshot completed successfully. Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ef95327c-7c54-4519-9d59-d03f44fc2205 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "cinder-quobyte-24abc6ca-15fd-4cb8-a241-e778543509e6" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-3d50c2ff-35ce-4a68-8f6d-780b4df2b757 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-9b05d672-e9d7-4d13-bd05-119e4c4d3e70-delete_snapshot" released by "delete_snapshot" :: held 2.869s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ef95327c-7c54-4519-9d59-d03f44fc2205 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-quobyte-24abc6ca-15fd-4cb8-a241-e778543509e6" acquired by "delete_volume" :: waited 0.022s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[aada0ba4-77b5-42c7-b1ce-452f7c877671]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ef95327c-7c54-4519-9d59-d03f44fc2205 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-24abc6ca-15fd-4cb8-a241-e778543509e6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6cf28520-53db-4e46-a643-18d14928620f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "cinder-72bb74ce-960d-43cc-9843-fdb46c7e1610-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6cf28520-53db-4e46-a643-18d14928620f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-72bb74ce-960d-43cc-9843-fdb46c7e1610-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6cf28520-53db-4e46-a643-18d14928620f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "cinder-quobyte-72bb74ce-960d-43cc-9843-fdb46c7e1610" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:50 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-24abc6ca-15fd-4cb8-a241-e778543509e6 Nov 03 07:45:50 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6cf28520-53db-4e46-a643-18d14928620f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-quobyte-72bb74ce-960d-43cc-9843-fdb46c7e1610" acquired by "delete_volume" :: waited 0.021s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4764e7-c1c7-416a-83d6-aa2881f52a5c]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cf28520-53db-4e46-a643-18d14928620f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-72bb74ce-960d-43cc-9843-fdb46c7e1610 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:51 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-72bb74ce-960d-43cc-9843-fdb46c7e1610 Nov 03 07:45:51 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6943f5d9-255e-4cff-8467-a74aa12a70a3 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6943f5d9-255e-4cff-8467-a74aa12a70a3 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6943f5d9-255e-4cff-8467-a74aa12a70a3 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:51 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6943f5d9-255e-4cff-8467-a74aa12a70a3 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6" acquired by "delete_volume" :: waited 0.026s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ef95327c-7c54-4519-9d59-d03f44fc2205 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-24abc6ca-15fd-4cb8-a241-e778543509e6" returned: 0 in 0.561s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ef95327c-7c54-4519-9d59-d03f44fc2205 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-24abc6ca-15fd-4cb8-a241-e778543509e6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed3aba6-7085-4008-9c2c-f6c52021b72e]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6943f5d9-255e-4cff-8467-a74aa12a70a3 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:51 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-24abc6ca-15fd-4cb8-a241-e778543509e6 Nov 03 07:45:51 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:51 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cf28520-53db-4e46-a643-18d14928620f tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-72bb74ce-960d-43cc-9843-fdb46c7e1610" returned: 0 in 0.484s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cf28520-53db-4e46-a643-18d14928620f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-72bb74ce-960d-43cc-9843-fdb46c7e1610 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:51 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6 Nov 03 07:45:51 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-72bb74ce-960d-43cc-9843-fdb46c7e1610 Nov 03 07:45:51 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:51 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:51 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ef95327c-7c54-4519-9d59-d03f44fc2205 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-24abc6ca-15fd-4cb8-a241-e778543509e6" returned: 0 in 0.314s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ef95327c-7c54-4519-9d59-d03f44fc2205 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-quobyte-24abc6ca-15fd-4cb8-a241-e778543509e6" released by "delete_volume" :: held 0.927s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-ef95327c-7c54-4519-9d59-d03f44fc2205 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Created reservations ['bca5342e-acce-42d4-afb0-9b949c32246a', 'a4478fb4-5227-42fa-b450-ab769e7e67ec', '8e445089-e714-4f57-9d85-11b3e221169e', 'f5ccb2c3-6df4-4313-bcc9-6f8595e8f2c8'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:51 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cf28520-53db-4e46-a643-18d14928620f tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-72bb74ce-960d-43cc-9843-fdb46c7e1610" returned: 0 in 0.322s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6cf28520-53db-4e46-a643-18d14928620f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-quobyte-72bb74ce-960d-43cc-9843-fdb46c7e1610" released by "delete_volume" :: held 0.854s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:51 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6943f5d9-255e-4cff-8467-a74aa12a70a3 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6" returned: 0 in 0.482s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6943f5d9-255e-4cff-8467-a74aa12a70a3 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ef95327c-7c54-4519-9d59-d03f44fc2205 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ef95327c-7c54-4519-9d59-d03f44fc2205 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ef95327c-7c54-4519-9d59-d03f44fc2205 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ef95327c-7c54-4519-9d59-d03f44fc2205 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ef95327c-7c54-4519-9d59-d03f44fc2205 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ef95327c-7c54-4519-9d59-d03f44fc2205 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:51 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6 Nov 03 07:45:51 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a0362a74-4033-43dd-9302-9aa2ebdf545a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "cinder-3e0c7346-8af9-4288-bb4a-b766f6936e6a-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:51 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:45:51 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-6cf28520-53db-4e46-a643-18d14928620f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Created reservations ['0f9820a0-f4c5-4ab1-a627-20c770215de5', '6e034bf6-9573-4894-8f25-037c5c1b86a2', 'e452640e-b9f3-41f8-86e5-e86521dabbdc', '17115fb3-83a7-4ce4-bcb2-9beb3c70f0d9'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:51 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a0362a74-4033-43dd-9302-9aa2ebdf545a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-3e0c7346-8af9-4288-bb4a-b766f6936e6a-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a0362a74-4033-43dd-9302-9aa2ebdf545a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "cinder-quobyte-3e0c7346-8af9-4288-bb4a-b766f6936e6a" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6cf28520-53db-4e46-a643-18d14928620f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6cf28520-53db-4e46-a643-18d14928620f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6cf28520-53db-4e46-a643-18d14928620f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6cf28520-53db-4e46-a643-18d14928620f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6cf28520-53db-4e46-a643-18d14928620f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cf28520-53db-4e46-a643-18d14928620f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a0362a74-4033-43dd-9302-9aa2ebdf545a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-quobyte-3e0c7346-8af9-4288-bb4a-b766f6936e6a" acquired by "delete_volume" :: waited 0.070s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:52 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:45:52 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5d2861-7f58-4a3c-ab4d-f65b5fec0b43]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0362a74-4033-43dd-9302-9aa2ebdf545a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3e0c7346-8af9-4288-bb4a-b766f6936e6a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:52 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6943f5d9-255e-4cff-8467-a74aa12a70a3 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6" returned: 0 in 0.431s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:52 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ef95327c-7c54-4519-9d59-d03f44fc2205 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.435s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-ef95327c-7c54-4519-9d59-d03f44fc2205 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6943f5d9-255e-4cff-8467-a74aa12a70a3 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6" released by "delete_volume" :: held 1.026s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:52 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3e0c7346-8af9-4288-bb4a-b766f6936e6a Nov 03 07:45:52 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:52 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ef95327c-7c54-4519-9d59-d03f44fc2205 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Deleted volume successfully. Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-ef95327c-7c54-4519-9d59-d03f44fc2205 tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-24abc6ca-15fd-4cb8-a241-e778543509e6-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-6943f5d9-255e-4cff-8467-a74aa12a70a3 tempest-ProjectMemberTests-2017513802 None] Created reservations ['5d4f5d2c-4c27-4e1b-b8ef-78b7b0dad982', '48252dbd-c895-463d-8b68-c85497bce975', '25095468-c338-4e3d-b915-4cc1dc8f9dbc', '03d65471-71ab-400e-a954-7f52955b247a'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6943f5d9-255e-4cff-8467-a74aa12a70a3 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6943f5d9-255e-4cff-8467-a74aa12a70a3 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6943f5d9-255e-4cff-8467-a74aa12a70a3 tempest-ProjectMemberTests-2017513802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:52 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-6943f5d9-255e-4cff-8467-a74aa12a70a3 tempest-ProjectMemberTests-2017513802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-6943f5d9-255e-4cff-8467-a74aa12a70a3 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6943f5d9-255e-4cff-8467-a74aa12a70a3 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6cf28520-53db-4e46-a643-18d14928620f tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.461s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-6cf28520-53db-4e46-a643-18d14928620f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:52 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-6cf28520-53db-4e46-a643-18d14928620f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Deleted volume successfully. Nov 03 07:45:52 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:45:52 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6cf28520-53db-4e46-a643-18d14928620f tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-72bb74ce-960d-43cc-9843-fdb46c7e1610-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:52 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0362a74-4033-43dd-9302-9aa2ebdf545a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3e0c7346-8af9-4288-bb4a-b766f6936e6a" returned: 0 in 0.460s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0362a74-4033-43dd-9302-9aa2ebdf545a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3e0c7346-8af9-4288-bb4a-b766f6936e6a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:52 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3e0c7346-8af9-4288-bb4a-b766f6936e6a Nov 03 07:45:52 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:52 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6943f5d9-255e-4cff-8467-a74aa12a70a3 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.281s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-6943f5d9-255e-4cff-8467-a74aa12a70a3 tempest-ProjectMemberTests-2017513802 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:52 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-6943f5d9-255e-4cff-8467-a74aa12a70a3 tempest-ProjectMemberTests-2017513802 None] Deleted volume successfully. Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6943f5d9-255e-4cff-8467-a74aa12a70a3 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-8a6bf3fb-cff4-4ebf-b695-992ee409a0e6-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:52 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0362a74-4033-43dd-9302-9aa2ebdf545a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-3e0c7346-8af9-4288-bb4a-b766f6936e6a" returned: 0 in 0.274s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a0362a74-4033-43dd-9302-9aa2ebdf545a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-quobyte-3e0c7346-8af9-4288-bb4a-b766f6936e6a" released by "delete_volume" :: held 0.793s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:52 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-a0362a74-4033-43dd-9302-9aa2ebdf545a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Created reservations ['b81a2a12-57bd-40a5-b155-d97c7e2969eb', '1b0706c6-4179-4bd3-9ca2-13ae4446727d', '06bcab52-c7fd-43af-8008-1cfde034d0cc', '72c2f289-8c77-4356-9a51-83c95080bcdd'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a0362a74-4033-43dd-9302-9aa2ebdf545a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a0362a74-4033-43dd-9302-9aa2ebdf545a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a0362a74-4033-43dd-9302-9aa2ebdf545a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:53 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a0362a74-4033-43dd-9302-9aa2ebdf545a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a0362a74-4033-43dd-9302-9aa2ebdf545a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0362a74-4033-43dd-9302-9aa2ebdf545a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:53 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:45:53 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-29c890ee-3386-46fa-bb2e-873d6d131c70 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "cinder-c17f2544-eb32-4d6a-a420-468e73b1e21e-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-29c890ee-3386-46fa-bb2e-873d6d131c70 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-c17f2544-eb32-4d6a-a420-468e73b1e21e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-29c890ee-3386-46fa-bb2e-873d6d131c70 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "cinder-quobyte-c17f2544-eb32-4d6a-a420-468e73b1e21e" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-29c890ee-3386-46fa-bb2e-873d6d131c70 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-quobyte-c17f2544-eb32-4d6a-a420-468e73b1e21e" acquired by "delete_volume" :: waited 0.026s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:53 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[7759fae4-74db-49c3-b635-a94ed84d6c44]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-29c890ee-3386-46fa-bb2e-873d6d131c70 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c17f2544-eb32-4d6a-a420-468e73b1e21e {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:53 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0362a74-4033-43dd-9302-9aa2ebdf545a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.324s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:53 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a0362a74-4033-43dd-9302-9aa2ebdf545a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:53 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a0362a74-4033-43dd-9302-9aa2ebdf545a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Deleted volume successfully. Nov 03 07:45:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a0362a74-4033-43dd-9302-9aa2ebdf545a tempest-CreateVolumesFromSourceVolumeTest-122999815 None] Lock "cinder-3e0c7346-8af9-4288-bb4a-b766f6936e6a-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:53 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c17f2544-eb32-4d6a-a420-468e73b1e21e Nov 03 07:45:53 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:53 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-29c890ee-3386-46fa-bb2e-873d6d131c70 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c17f2544-eb32-4d6a-a420-468e73b1e21e" returned: 0 in 0.453s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-29c890ee-3386-46fa-bb2e-873d6d131c70 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c17f2544-eb32-4d6a-a420-468e73b1e21e {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:53 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c17f2544-eb32-4d6a-a420-468e73b1e21e Nov 03 07:45:53 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Flow 'volume_create_manager' (d7ae53c4-65f8-42ec-91d5-319d4c02399c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90663da4-aa48-4e67-bcae-994accfe46be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:54 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-29c890ee-3386-46fa-bb2e-873d6d131c70 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c17f2544-eb32-4d6a-a420-468e73b1e21e" returned: 0 in 0.363s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90663da4-aa48-4e67-bcae-994accfe46be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1994155292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62000db1-f443-4429-b67d-3cf2ed3dac53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed98c25bc1c64da3a0227cf8c7bef103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:54Z,use_quota=True,user_id='3b3ce7b9c2864a2db5285861bf4701c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ddfb28-9599-4180-95cf-2ee7523abbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ddfb28-9599-4180-95cf-2ee7523abbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2cda333-682d-42f0-a04a-ac5af8115899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2cda333-682d-42f0-a04a-ac5af8115899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62000db1-f443-4429-b67d-3cf2ed3dac53', 'volume_name': 'volume-62000db1-f443-4429-b67d-3cf2ed3dac53', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a993d40f-8843-45ed-8506-d72bfbf9ad03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a993d40f-8843-45ed-8506-d72bfbf9ad03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21606cbe-f3bc-48b0-8640-99afc786c458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:54 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Volume 62000db1-f443-4429-b67d-3cf2ed3dac53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62000db1-f443-4429-b67d-3cf2ed3dac53', 'volume_size': 1} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1994155292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62000db1-f443-4429-b67d-3cf2ed3dac53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed98c25bc1c64da3a0227cf8c7bef103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:54Z,use_quota=True,user_id='3b3ce7b9c2864a2db5285861bf4701c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Creating volume 62000db1-f443-4429-b67d-3cf2ed3dac53 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:54 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-29c890ee-3386-46fa-bb2e-873d6d131c70 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-quobyte-c17f2544-eb32-4d6a-a420-468e73b1e21e" released by "delete_volume" :: held 0.957s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:54 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53 1073741824 Nov 03 07:45:54 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-29c890ee-3386-46fa-bb2e-873d6d131c70 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Created reservations ['4c2bd45d-00e2-486a-b524-9b33af623760', '75e18104-019a-4d77-8c4b-a406d54a801c', 'c438663c-04a5-48d5-8bff-4de6adbd9d18', '12e5562a-8341-4077-84f5-b1af6e995282'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-29c890ee-3386-46fa-bb2e-873d6d131c70 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-29c890ee-3386-46fa-bb2e-873d6d131c70 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-29c890ee-3386-46fa-bb2e-873d6d131c70 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-29c890ee-3386-46fa-bb2e-873d6d131c70 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-29c890ee-3386-46fa-bb2e-873d6d131c70 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-29c890ee-3386-46fa-bb2e-873d6d131c70 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:54 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:45:54 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:54 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-29c890ee-3386-46fa-bb2e-873d6d131c70 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.326s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-29c890ee-3386-46fa-bb2e-873d6d131c70 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:54 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-29c890ee-3386-46fa-bb2e-873d6d131c70 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Deleted volume successfully. Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-29c890ee-3386-46fa-bb2e-873d6d131c70 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-c17f2544-eb32-4d6a-a420-468e73b1e21e-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:54 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53 1073741824" returned: 0 in 0.639s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:54 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53 Nov 03 07:45:54 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:55 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53" returned: 0 in 0.304s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:55 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:45:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21606cbe-f3bc-48b0-8640-99afc786c458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62000db1-f443-4429-b67d-3cf2ed3dac53', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4dc6726-c40e-4b24-9d4a-450f2f1a63aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:55 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Volume volume-62000db1-f443-4429-b67d-3cf2ed3dac53 (62000db1-f443-4429-b67d-3cf2ed3dac53): created successfully Nov 03 07:45:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4dc6726-c40e-4b24-9d4a-450f2f1a63aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:55 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Flow 'volume_create_manager' (d7ae53c4-65f8-42ec-91d5-319d4c02399c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:55 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-169e886e-b69f-4a07-8eb2-467825915e53 tempest-ProjectMemberTests-2017513802 None] Created volume successfully. Nov 03 07:45:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-abd913fb-44eb-4eac-b978-e92e49968291 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "cinder-c1d5ce86-15a5-40d0-a254-f3d97afe5d90-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-abd913fb-44eb-4eac-b978-e92e49968291 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-c1d5ce86-15a5-40d0-a254-f3d97afe5d90-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-abd913fb-44eb-4eac-b978-e92e49968291 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "cinder-quobyte-c1d5ce86-15a5-40d0-a254-f3d97afe5d90" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-abd913fb-44eb-4eac-b978-e92e49968291 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-quobyte-c1d5ce86-15a5-40d0-a254-f3d97afe5d90" acquired by "delete_volume" :: waited 0.018s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:55 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49e8a33-9052-4c47-ba08-44cc47e6e841]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-abd913fb-44eb-4eac-b978-e92e49968291 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1d5ce86-15a5-40d0-a254-f3d97afe5d90 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:55 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1d5ce86-15a5-40d0-a254-f3d97afe5d90 Nov 03 07:45:55 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:56 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-abd913fb-44eb-4eac-b978-e92e49968291 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1d5ce86-15a5-40d0-a254-f3d97afe5d90" returned: 0 in 0.417s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-abd913fb-44eb-4eac-b978-e92e49968291 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1d5ce86-15a5-40d0-a254-f3d97afe5d90 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:56 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1d5ce86-15a5-40d0-a254-f3d97afe5d90 Nov 03 07:45:56 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0bc3e78f-ad2b-495e-b887-2bce42281d3e tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0bc3e78f-ad2b-495e-b887-2bce42281d3e tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-0bc3e78f-ad2b-495e-b887-2bce42281d3e tempest-ProjectMemberTests-2017513802 None] Creating offline snapshot 96834636-15ac-4d9a-84b9-e12adef41d06 of volume 62000db1-f443-4429-b67d-3cf2ed3dac53 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:45:56 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-abd913fb-44eb-4eac-b978-e92e49968291 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1d5ce86-15a5-40d0-a254-f3d97afe5d90" returned: 0 in 0.356s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-abd913fb-44eb-4eac-b978-e92e49968291 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-quobyte-c1d5ce86-15a5-40d0-a254-f3d97afe5d90" released by "delete_volume" :: held 0.829s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6966d2-ecd2-4d5a-a15e-073514ad5026]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0bc3e78f-ad2b-495e-b887-2bce42281d3e tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-abd913fb-44eb-4eac-b978-e92e49968291 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Created reservations ['21f1ff7d-896f-4179-b82e-850da295d425', 'c82f346f-d8d6-4c34-8c5c-b67336b00036', '23ae0f96-db8a-4201-80e2-4f6e33b02c31', 'be3af648-23c1-4346-82b9-c50ea9c277e0'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-abd913fb-44eb-4eac-b978-e92e49968291 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-abd913fb-44eb-4eac-b978-e92e49968291 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-abd913fb-44eb-4eac-b978-e92e49968291 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-abd913fb-44eb-4eac-b978-e92e49968291 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-abd913fb-44eb-4eac-b978-e92e49968291 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-abd913fb-44eb-4eac-b978-e92e49968291 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:56 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53 Nov 03 07:45:56 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:56 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:45:56 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b4f1d404-1108-46e5-9085-35965463ef63 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "cinder-c8dfec34-2c9e-40a6-8110-8a24adfcb2e7-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b4f1d404-1108-46e5-9085-35965463ef63 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-c8dfec34-2c9e-40a6-8110-8a24adfcb2e7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b4f1d404-1108-46e5-9085-35965463ef63 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "cinder-quobyte-c8dfec34-2c9e-40a6-8110-8a24adfcb2e7" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b4f1d404-1108-46e5-9085-35965463ef63 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-quobyte-c8dfec34-2c9e-40a6-8110-8a24adfcb2e7" acquired by "delete_volume" :: waited 0.030s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d330cc6-1d3c-4f6e-8058-afe1d582e246]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b4f1d404-1108-46e5-9085-35965463ef63 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c8dfec34-2c9e-40a6-8110-8a24adfcb2e7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:56 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0bc3e78f-ad2b-495e-b887-2bce42281d3e tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53" returned: 0 in 0.529s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0bc3e78f-ad2b-495e-b887-2bce42281d3e tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.96834636-15ac-4d9a-84b9-e12adef41d06 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:56 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-abd913fb-44eb-4eac-b978-e92e49968291 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.406s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:57 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-abd913fb-44eb-4eac-b978-e92e49968291 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:57 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.96834636-15ac-4d9a-84b9-e12adef41d06 1G Nov 03 07:45:57 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-abd913fb-44eb-4eac-b978-e92e49968291 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Deleted volume successfully. Nov 03 07:45:57 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:57 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c8dfec34-2c9e-40a6-8110-8a24adfcb2e7 Nov 03 07:45:57 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-abd913fb-44eb-4eac-b978-e92e49968291 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-c1d5ce86-15a5-40d0-a254-f3d97afe5d90-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:57 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b4f1d404-1108-46e5-9085-35965463ef63 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c8dfec34-2c9e-40a6-8110-8a24adfcb2e7" returned: 0 in 0.543s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b4f1d404-1108-46e5-9085-35965463ef63 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c8dfec34-2c9e-40a6-8110-8a24adfcb2e7 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:57 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c8dfec34-2c9e-40a6-8110-8a24adfcb2e7 Nov 03 07:45:57 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:57 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0bc3e78f-ad2b-495e-b887-2bce42281d3e tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.96834636-15ac-4d9a-84b9-e12adef41d06 1G" returned: 0 in 0.602s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0bc3e78f-ad2b-495e-b887-2bce42281d3e tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62000db1-f443-4429-b67d-3cf2ed3dac53 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.96834636-15ac-4d9a-84b9-e12adef41d06 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:57 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62000db1-f443-4429-b67d-3cf2ed3dac53 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.96834636-15ac-4d9a-84b9-e12adef41d06 Nov 03 07:45:57 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:57 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b4f1d404-1108-46e5-9085-35965463ef63 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c8dfec34-2c9e-40a6-8110-8a24adfcb2e7" returned: 0 in 0.360s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b4f1d404-1108-46e5-9085-35965463ef63 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-quobyte-c8dfec34-2c9e-40a6-8110-8a24adfcb2e7" released by "delete_volume" :: held 0.968s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:57 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-b4f1d404-1108-46e5-9085-35965463ef63 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Created reservations ['97a1132a-dd7d-48d5-bde3-381609b077d9', 'bbd4cefe-7090-4569-97c4-12f0ca893286', 'c9abb437-1e5d-4e21-8c25-08a59eb429a3', 'cec9aab0-738d-4dc8-90d0-e153b45a3360'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:57 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0bc3e78f-ad2b-495e-b887-2bce42281d3e tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62000db1-f443-4429-b67d-3cf2ed3dac53 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.96834636-15ac-4d9a-84b9-e12adef41d06" returned: 0 in 0.396s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:57 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-0bc3e78f-ad2b-495e-b887-2bce42281d3e tempest-ProjectMemberTests-2017513802 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.96834636-15ac-4d9a-84b9-e12adef41d06 is being set with open permissions: ugo+rw Nov 03 07:45:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0bc3e78f-ad2b-495e-b887-2bce42281d3e tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.96834636-15ac-4d9a-84b9-e12adef41d06 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b4f1d404-1108-46e5-9085-35965463ef63 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b4f1d404-1108-46e5-9085-35965463ef63 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b4f1d404-1108-46e5-9085-35965463ef63 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:58 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.96834636-15ac-4d9a-84b9-e12adef41d06 Nov 03 07:45:58 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b4f1d404-1108-46e5-9085-35965463ef63 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b4f1d404-1108-46e5-9085-35965463ef63 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b4f1d404-1108-46e5-9085-35965463ef63 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:58 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:45:58 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:58 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0bc3e78f-ad2b-495e-b887-2bce42281d3e tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.96834636-15ac-4d9a-84b9-e12adef41d06" returned: 0 in 0.356s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:58 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b4f1d404-1108-46e5-9085-35965463ef63 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.320s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:58 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-b4f1d404-1108-46e5-9085-35965463ef63 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:58 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b4f1d404-1108-46e5-9085-35965463ef63 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Deleted volume successfully. Nov 03 07:45:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0bc3e78f-ad2b-495e-b887-2bce42281d3e tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:58 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b4f1d404-1108-46e5-9085-35965463ef63 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-c8dfec34-2c9e-40a6-8110-8a24adfcb2e7-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:58 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.info Nov 03 07:45:58 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:58 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0bc3e78f-ad2b-495e-b887-2bce42281d3e tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.info" returned: 0 in 0.318s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:58 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-0bc3e78f-ad2b-495e-b887-2bce42281d3e tempest-ProjectMemberTests-2017513802 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.info is being set with open permissions: ugo+rw Nov 03 07:45:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0bc3e78f-ad2b-495e-b887-2bce42281d3e tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:58 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.info Nov 03 07:45:58 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:59 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0bc3e78f-ad2b-495e-b887-2bce42281d3e tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.info" returned: 0 in 0.285s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0bc3e78f-ad2b-495e-b887-2bce42281d3e tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.648s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-89ac5865-f16f-4eb1-9de0-ffdb49e40af9 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "cinder-7994334b-8dd4-4184-b0aa-83393ae83f62-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-89ac5865-f16f-4eb1-9de0-ffdb49e40af9 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-7994334b-8dd4-4184-b0aa-83393ae83f62-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:59 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-0bc3e78f-ad2b-495e-b887-2bce42281d3e tempest-ProjectMemberTests-2017513802 None] Create snapshot completed successfully Nov 03 07:45:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-89ac5865-f16f-4eb1-9de0-ffdb49e40af9 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "cinder-quobyte-7994334b-8dd4-4184-b0aa-83393ae83f62" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-89ac5865-f16f-4eb1-9de0-ffdb49e40af9 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-quobyte-7994334b-8dd4-4184-b0aa-83393ae83f62" acquired by "delete_volume" :: waited 0.020s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:59 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fb089e-4439-4c92-8c78-4d40620b3c7a]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-89ac5865-f16f-4eb1-9de0-ffdb49e40af9 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7994334b-8dd4-4184-b0aa-83393ae83f62 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:59 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7994334b-8dd4-4184-b0aa-83393ae83f62 Nov 03 07:45:59 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-08b3bcef-1f79-4917-b8b1-cdf68c31a956 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-96834636-15ac-4d9a-84b9-e12adef41d06-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-08b3bcef-1f79-4917-b8b1-cdf68c31a956 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-96834636-15ac-4d9a-84b9-e12adef41d06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-08b3bcef-1f79-4917-b8b1-cdf68c31a956 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-62000db1-f443-4429-b67d-3cf2ed3dac53" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-08b3bcef-1f79-4917-b8b1-cdf68c31a956 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-62000db1-f443-4429-b67d-3cf2ed3dac53" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-08b3bcef-1f79-4917-b8b1-cdf68c31a956 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-96834636-15ac-4d9a-84b9-e12adef41d06" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-08b3bcef-1f79-4917-b8b1-cdf68c31a956 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-96834636-15ac-4d9a-84b9-e12adef41d06" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:59 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-08b3bcef-1f79-4917-b8b1-cdf68c31a956 tempest-ProjectMemberTests-2017513802 None] Deleting offline snapshot 96834636-15ac-4d9a-84b9-e12adef41d06 of volume 62000db1-f443-4429-b67d-3cf2ed3dac53 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:45:59 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-08b3bcef-1f79-4917-b8b1-cdf68c31a956 tempest-ProjectMemberTests-2017513802 None] snapshot_file for this snap is: volume-62000db1-f443-4429-b67d-3cf2ed3dac53.96834636-15ac-4d9a-84b9-e12adef41d06 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:45:59 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7f949c-dfd8-4b63-9aa7-f6e0f4893954]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:59 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-08b3bcef-1f79-4917-b8b1-cdf68c31a956 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.96834636-15ac-4d9a-84b9-e12adef41d06 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-89ac5865-f16f-4eb1-9de0-ffdb49e40af9 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7994334b-8dd4-4184-b0aa-83393ae83f62" returned: 0 in 0.487s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-89ac5865-f16f-4eb1-9de0-ffdb49e40af9 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7994334b-8dd4-4184-b0aa-83393ae83f62 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:59 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7994334b-8dd4-4184-b0aa-83393ae83f62 Nov 03 07:45:59 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:59 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.96834636-15ac-4d9a-84b9-e12adef41d06 Nov 03 07:45:59 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:59 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-89ac5865-f16f-4eb1-9de0-ffdb49e40af9 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7994334b-8dd4-4184-b0aa-83393ae83f62" returned: 0 in 0.270s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-89ac5865-f16f-4eb1-9de0-ffdb49e40af9 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-quobyte-7994334b-8dd4-4184-b0aa-83393ae83f62" released by "delete_volume" :: held 0.819s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=213,cinder:UPDATE=260,cinder:DELETE=24,cinder:INSERT=59 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:UPDATE=272,cinder:SELECT=178,cinder:INSERT=76,cinder:DELETE=26 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-89ac5865-f16f-4eb1-9de0-ffdb49e40af9 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Created reservations ['37d33266-06d0-4cdd-a471-2cbc25d8ee12', '4ca589dd-e4db-4b6e-8ab4-5e0d98941e0c', '400146f2-83ba-4773-bd81-c05780520749', 'd181bd62-ffd3-4094-85bf-8815c3a20faa'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:00 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-08b3bcef-1f79-4917-b8b1-cdf68c31a956 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.96834636-15ac-4d9a-84b9-e12adef41d06" returned: 0 in 0.494s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-08b3bcef-1f79-4917-b8b1-cdf68c31a956 tempest-ProjectMemberTests-2017513802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62000db1-f443-4429-b67d-3cf2ed3dac53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-89ac5865-f16f-4eb1-9de0-ffdb49e40af9 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-89ac5865-f16f-4eb1-9de0-ffdb49e40af9 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-89ac5865-f16f-4eb1-9de0-ffdb49e40af9 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-89ac5865-f16f-4eb1-9de0-ffdb49e40af9 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-89ac5865-f16f-4eb1-9de0-ffdb49e40af9 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-89ac5865-f16f-4eb1-9de0-ffdb49e40af9 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[0131ce55-4fd5-46e9-a058-d23dcb03cf03]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-08b3bcef-1f79-4917-b8b1-cdf68c31a956 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:00 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:46:00 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0019572b-6771-469a-aea4-ab68a11296d0 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "cinder-0e343f65-ca78-4a70-974a-9c42f5a91a6e-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0019572b-6771-469a-aea4-ab68a11296d0 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-0e343f65-ca78-4a70-974a-9c42f5a91a6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.091s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0019572b-6771-469a-aea4-ab68a11296d0 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "cinder-quobyte-a8f72970-01d2-418e-a48e-c714e4481c9c" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0019572b-6771-469a-aea4-ab68a11296d0 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-quobyte-a8f72970-01d2-418e-a48e-c714e4481c9c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0019572b-6771-469a-aea4-ab68a11296d0 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "cinder-quobyte-0e343f65-ca78-4a70-974a-9c42f5a91a6e" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0019572b-6771-469a-aea4-ab68a11296d0 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-quobyte-0e343f65-ca78-4a70-974a-9c42f5a91a6e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-0019572b-6771-469a-aea4-ab68a11296d0 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Deleting offline snapshot 0e343f65-ca78-4a70-974a-9c42f5a91a6e of volume a8f72970-01d2-418e-a48e-c714e4481c9c {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-0019572b-6771-469a-aea4-ab68a11296d0 tempest-CreateVolumesFromSnapshotTest-1376318347 None] snapshot_file for this snap is: volume-a8f72970-01d2-418e-a48e-c714e4481c9c.0e343f65-ca78-4a70-974a-9c42f5a91a6e {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc78a02-2118-46c5-8258-6c990fa461e5]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0019572b-6771-469a-aea4-ab68a11296d0 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.0e343f65-ca78-4a70-974a-9c42f5a91a6e {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:00 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53 Nov 03 07:46:00 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:00 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-89ac5865-f16f-4eb1-9de0-ffdb49e40af9 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.349s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-89ac5865-f16f-4eb1-9de0-ffdb49e40af9 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:00 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-89ac5865-f16f-4eb1-9de0-ffdb49e40af9 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Deleted volume successfully. Nov 03 07:46:00 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.0e343f65-ca78-4a70-974a-9c42f5a91a6e Nov 03 07:46:00 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-89ac5865-f16f-4eb1-9de0-ffdb49e40af9 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-7994334b-8dd4-4184-b0aa-83393ae83f62-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:00 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:00 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-08b3bcef-1f79-4917-b8b1-cdf68c31a956 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53" returned: 0 in 0.666s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-08b3bcef-1f79-4917-b8b1-cdf68c31a956 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.96834636-15ac-4d9a-84b9-e12adef41d06 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0019572b-6771-469a-aea4-ab68a11296d0 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.0e343f65-ca78-4a70-974a-9c42f5a91a6e" returned: 0 in 0.437s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-0019572b-6771-469a-aea4-ab68a11296d0 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8f72970-01d2-418e-a48e-c714e4481c9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:46:00 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.96834636-15ac-4d9a-84b9-e12adef41d06 Nov 03 07:46:00 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ae32f3-0276-4047-b7dc-9b109897ab79]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0019572b-6771-469a-aea4-ab68a11296d0 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Flow 'volume_create_manager' (0bde2919-4d47-4287-a5ee-409cd36a1e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46710371-4421-4b4f-ba73-93df503fc641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46710371-4421-4b4f-ba73-93df503fc641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4f1aac-59ee-42be-bca6-6572ac06a8cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c534131db87436e9ea3e776fb294977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:01Z,use_quota=True,user_id='77dcc1879c614981b88c9855ca6cf158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ed0c53-3ff5-44ea-ae70-9b3f933daab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:01 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c Nov 03 07:46:01 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ed0c53-3ff5-44ea-ae70-9b3f933daab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8898fb3-4082-4970-b8d5-7cd8b5e4911a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.image.glance [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Creating Keystone auth plugin from conf {{(pid=87016) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:46:01 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-08b3bcef-1f79-4917-b8b1-cdf68c31a956 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.96834636-15ac-4d9a-84b9-e12adef41d06" returned: 0 in 0.551s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-08b3bcef-1f79-4917-b8b1-cdf68c31a956 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.96834636-15ac-4d9a-84b9-e12adef41d06 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:01 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.96834636-15ac-4d9a-84b9-e12adef41d06 Nov 03 07:46:01 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:01 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0019572b-6771-469a-aea4-ab68a11296d0 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c" returned: 0 in 0.520s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0019572b-6771-469a-aea4-ab68a11296d0 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.0e343f65-ca78-4a70-974a-9c42f5a91a6e {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:01 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.0e343f65-ca78-4a70-974a-9c42f5a91a6e Nov 03 07:46:01 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Flow 'volume_create_manager' (73fa67ff-d2f5-41ea-a658-708b307ef02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ced8b9-9932-4447-b848-37da687a7dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ced8b9-9932-4447-b848-37da687a7dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1461240709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabf9c4b-271a-4c30-8266-7d8d56f8fcc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d52323e76842416186d6aec6d7a88897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:02Z,use_quota=True,user_id='40b77a22c13f4e4c89ce15a331b12d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3daa12b-562f-44c6-bceb-ff1307bf9716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3daa12b-562f-44c6-bceb-ff1307bf9716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8550f1e2-4998-4257-8183-7f459b9cc633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8550f1e2-4998-4257-8183-7f459b9cc633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dabf9c4b-271a-4c30-8266-7d8d56f8fcc9', 'volume_name': 'volume-dabf9c4b-271a-4c30-8266-7d8d56f8fcc9', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252de051-984a-4c16-88dd-29d261a7f4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252de051-984a-4c16-88dd-29d261a7f4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf64076-cabb-49c9-ba9f-d662f81dd50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:01 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Volume dabf9c4b-271a-4c30-8266-7d8d56f8fcc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dabf9c4b-271a-4c30-8266-7d8d56f8fcc9', 'volume_size': 1} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1461240709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabf9c4b-271a-4c30-8266-7d8d56f8fcc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d52323e76842416186d6aec6d7a88897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:02Z,use_quota=True,user_id='40b77a22c13f4e4c89ce15a331b12d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Creating volume dabf9c4b-271a-4c30-8266-7d8d56f8fcc9 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:01 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dabf9c4b-271a-4c30-8266-7d8d56f8fcc9 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:01 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dabf9c4b-271a-4c30-8266-7d8d56f8fcc9 1073741824 Nov 03 07:46:01 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8898fb3-4082-4970-b8d5-7cd8b5e4911a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4e4f1aac-59ee-42be-bca6-6572ac06a8cb', 'volume_name': 'volume-4e4f1aac-59ee-42be-bca6-6572ac06a8cb', 'volume_size': 1, 'image_id': '5e116e2a-e358-4024-868b-7f3c27a84125', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5e116e2a-e358-4024-868b-7f3c27a84125', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9712c3b855394bcdcff7d20a0c7337cd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4c534131db87436e9ea3e776fb294977', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e82946451560849d62f121e267077b8c9a79df4822005eaea5a881cd1ec9e8a69206c17599a0aeb8a4929338b4191af63d61e89ccdc56504e0ef60663552e1ff', 'id': '5e116e2a-e358-4024-868b-7f3c27a84125', 'created_at': datetime.datetime(2026, 11, 3, 6, 45, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 45, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5e116e2a-e358-4024-868b-7f3c27a84125/file', 'properties': {}}, 'image_service': }' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3936a074-58cd-43f2-a39a-831d38fa689a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3936a074-58cd-43f2-a39a-831d38fa689a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b713e5-ad0f-4d55-a2e7-05da224bbbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:01 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Volume 4e4f1aac-59ee-42be-bca6-6572ac06a8cb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4e4f1aac-59ee-42be-bca6-6572ac06a8cb', 'volume_size': 1, 'image_id': '5e116e2a-e358-4024-868b-7f3c27a84125', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5e116e2a-e358-4024-868b-7f3c27a84125', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9712c3b855394bcdcff7d20a0c7337cd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4c534131db87436e9ea3e776fb294977', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e82946451560849d62f121e267077b8c9a79df4822005eaea5a881cd1ec9e8a69206c17599a0aeb8a4929338b4191af63d61e89ccdc56504e0ef60663552e1ff', 'id': '5e116e2a-e358-4024-868b-7f3c27a84125', 'created_at': datetime.datetime(2026, 11, 3, 6, 45, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 45, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5e116e2a-e358-4024-868b-7f3c27a84125/file', 'properties': {}}, 'image_service': } Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Trying to clone 4e4f1aac-59ee-42be-bca6-6572ac06a8cb from image 5e116e2a-e358-4024-868b-7f3c27a84125 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5e116e2a-e358-4024-868b-7f3c27a84125', 'metadata': {}}]). {{(pid=87016) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:46:01 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-08b3bcef-1f79-4917-b8b1-cdf68c31a956 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53.96834636-15ac-4d9a-84b9-e12adef41d06" returned: 0 in 0.339s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-08b3bcef-1f79-4917-b8b1-cdf68c31a956 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-96834636-15ac-4d9a-84b9-e12adef41d06" released by "_delete_snapshot" :: held 2.248s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-08b3bcef-1f79-4917-b8b1-cdf68c31a956 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-62000db1-f443-4429-b67d-3cf2ed3dac53" released by "delete_snapshot" :: held 2.289s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:46:01 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Image download 0.00 MB at 0.00 MB/s Nov 03 07:46:01 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[84743822-b9e1-4735-a156-eaee98ac5128]: (4, 'raw') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:02 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-08b3bcef-1f79-4917-b8b1-cdf68c31a956 tempest-ProjectMemberTests-2017513802 None] Created reservations ['0eb00df8-2602-4e51-ab4b-a34fd25ca47a', 'ff93efb8-1a52-40bb-bf8f-1ce73a87bff4', 'ecdd95a4-c6b4-45af-9bfe-8a41546669ff', 'ef44cd80-7597-4f7e-9407-de15d6931044'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0019572b-6771-469a-aea4-ab68a11296d0 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.0e343f65-ca78-4a70-974a-9c42f5a91a6e" returned: 0 in 0.485s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0019572b-6771-469a-aea4-ab68a11296d0 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.0e343f65-ca78-4a70-974a-9c42f5a91a6e {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:02 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.0e343f65-ca78-4a70-974a-9c42f5a91a6e Nov 03 07:46:02 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:02 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-08b3bcef-1f79-4917-b8b1-cdf68c31a956 tempest-ProjectMemberTests-2017513802 None] Delete snapshot completed successfully. Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-08b3bcef-1f79-4917-b8b1-cdf68c31a956 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-96834636-15ac-4d9a-84b9-e12adef41d06-delete_snapshot" released by "delete_snapshot" :: held 2.524s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:02 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD Nov 03 07:46:02 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:02 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dabf9c4b-271a-4c30-8266-7d8d56f8fcc9 1073741824" returned: 0 in 0.570s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dabf9c4b-271a-4c30-8266-7d8d56f8fcc9 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:02 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0019572b-6771-469a-aea4-ab68a11296d0 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c.0e343f65-ca78-4a70-974a-9c42f5a91a6e" returned: 0 in 0.338s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:02 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dabf9c4b-271a-4c30-8266-7d8d56f8fcc9 Nov 03 07:46:02 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:02 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0019572b-6771-469a-aea4-ab68a11296d0 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-quobyte-0e343f65-ca78-4a70-974a-9c42f5a91a6e" released by "_delete_snapshot" :: held 1.967s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0019572b-6771-469a-aea4-ab68a11296d0 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-quobyte-a8f72970-01d2-418e-a48e-c714e4481c9c" released by "delete_snapshot" :: held 2.011s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-0019572b-6771-469a-aea4-ab68a11296d0 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Created reservations ['e11f9069-2a4c-441c-b749-5c6b087bc7a3', '54243ee3-e2a9-4b7e-a20e-17d608c37ad7', 'd1985d16-9d63-4f08-abae-1cebc1f650c9', '889f9f86-7a8a-43b4-b9bb-8ea4ccf13677'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:02 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD Nov 03 07:46:02 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:02 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-0019572b-6771-469a-aea4-ab68a11296d0 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Delete snapshot completed successfully. Nov 03 07:46:02 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dabf9c4b-271a-4c30-8266-7d8d56f8fcc9" returned: 0 in 0.270s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0019572b-6771-469a-aea4-ab68a11296d0 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-0e343f65-ca78-4a70-974a-9c42f5a91a6e-delete_snapshot" released by "delete_snapshot" :: held 2.193s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf64076-cabb-49c9-ba9f-d662f81dd50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dabf9c4b-271a-4c30-8266-7d8d56f8fcc9', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44825e04-9dc4-494f-b0c1-6f556255dac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:02 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Volume volume-dabf9c4b-271a-4c30-8266-7d8d56f8fcc9 (dabf9c4b-271a-4c30-8266-7d8d56f8fcc9): created successfully Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44825e04-9dc4-494f-b0c1-6f556255dac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Flow 'volume_create_manager' (73fa67ff-d2f5-41ea-a658-708b307ef02f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:02 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-e48cf87a-4745-4361-85db-d49542f6e964 tempest-ProjectReaderTests-797494389 None] Created volume successfully. Nov 03 07:46:02 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Temporary image 5e116e2a-e358-4024-868b-7f3c27a84125 is fetched for user 77dcc1879c614981b88c9855ca6cf158. {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac691e80-c058-4fd8-8dc5-d316b8f1b03a]: (4, 'raw') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:02 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD Nov 03 07:46:02 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-22efb46b-0fc2-4032-97d6-0ca0304c5ad1 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-62000db1-f443-4429-b67d-3cf2ed3dac53-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:02 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-22efb46b-0fc2-4032-97d6-0ca0304c5ad1 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-62000db1-f443-4429-b67d-3cf2ed3dac53-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-22efb46b-0fc2-4032-97d6-0ca0304c5ad1 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-62000db1-f443-4429-b67d-3cf2ed3dac53" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-22efb46b-0fc2-4032-97d6-0ca0304c5ad1 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-62000db1-f443-4429-b67d-3cf2ed3dac53" acquired by "delete_volume" :: waited 0.015s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32bd14d-cddc-4ac0-8c59-9d8ede9e6bc7]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-22efb46b-0fc2-4032-97d6-0ca0304c5ad1 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:03 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:03 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53 Nov 03 07:46:03 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:03 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD Nov 03 07:46:03 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:03 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-22efb46b-0fc2-4032-97d6-0ca0304c5ad1 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53" returned: 0 in 0.386s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-22efb46b-0fc2-4032-97d6-0ca0304c5ad1 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:03 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53 Nov 03 07:46:03 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:03 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD" returned: 1 in 0.392s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4f1aac-59ee-42be-bca6-6572ac06a8cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c534131db87436e9ea3e776fb294977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:01Z,use_quota=True,user_id='77dcc1879c614981b88c9855ca6cf158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Creating volume 4e4f1aac-59ee-42be-bca6-6572ac06a8cb {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:03 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e4f1aac-59ee-42be-bca6-6572ac06a8cb 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f17b6e8c-26f9-4446-80c7-3141494221c3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "cinder-a8f72970-01d2-418e-a48e-c714e4481c9c-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:03 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e4f1aac-59ee-42be-bca6-6572ac06a8cb 1073741824 Nov 03 07:46:03 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f17b6e8c-26f9-4446-80c7-3141494221c3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-a8f72970-01d2-418e-a48e-c714e4481c9c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f17b6e8c-26f9-4446-80c7-3141494221c3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "cinder-quobyte-a8f72970-01d2-418e-a48e-c714e4481c9c" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f17b6e8c-26f9-4446-80c7-3141494221c3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-quobyte-a8f72970-01d2-418e-a48e-c714e4481c9c" acquired by "delete_volume" :: waited 0.020s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[c207585f-2575-45b9-9386-4efbd977633c]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f17b6e8c-26f9-4446-80c7-3141494221c3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:03 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-22efb46b-0fc2-4032-97d6-0ca0304c5ad1 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-62000db1-f443-4429-b67d-3cf2ed3dac53" returned: 0 in 0.394s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-22efb46b-0fc2-4032-97d6-0ca0304c5ad1 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-62000db1-f443-4429-b67d-3cf2ed3dac53" released by "delete_volume" :: held 0.857s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:03 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c Nov 03 07:46:03 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-22efb46b-0fc2-4032-97d6-0ca0304c5ad1 tempest-ProjectMemberTests-2017513802 None] Created reservations ['dc114b78-da90-4427-8082-3d608f365361', '644c934a-2069-4b2f-97c7-a0f972b1903e', '12fbb9f3-67e5-4694-95d9-ef00c350bd78', 'f47559a2-fe45-48b0-8598-2ed8c5c20a5c'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b0bd727f-7932-48c7-a0a4-13964fec4faf tempest-ProjectReaderTests-797494389 None] Acquiring lock "cinder-dabf9c4b-271a-4c30-8266-7d8d56f8fcc9-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b0bd727f-7932-48c7-a0a4-13964fec4faf tempest-ProjectReaderTests-797494389 None] Lock "cinder-dabf9c4b-271a-4c30-8266-7d8d56f8fcc9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b0bd727f-7932-48c7-a0a4-13964fec4faf tempest-ProjectReaderTests-797494389 None] Acquiring lock "cinder-quobyte-dabf9c4b-271a-4c30-8266-7d8d56f8fcc9" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b0bd727f-7932-48c7-a0a4-13964fec4faf tempest-ProjectReaderTests-797494389 None] Lock "cinder-quobyte-dabf9c4b-271a-4c30-8266-7d8d56f8fcc9" acquired by "delete_volume" :: waited 0.025s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a15821-4d66-4ab6-96da-4ebcd9fe0a2b]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b0bd727f-7932-48c7-a0a4-13964fec4faf tempest-ProjectReaderTests-797494389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dabf9c4b-271a-4c30-8266-7d8d56f8fcc9 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:04 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e4f1aac-59ee-42be-bca6-6572ac06a8cb 1073741824" returned: 0 in 0.684s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-22efb46b-0fc2-4032-97d6-0ca0304c5ad1 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-22efb46b-0fc2-4032-97d6-0ca0304c5ad1 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-22efb46b-0fc2-4032-97d6-0ca0304c5ad1 tempest-ProjectMemberTests-2017513802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-22efb46b-0fc2-4032-97d6-0ca0304c5ad1 tempest-ProjectMemberTests-2017513802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-22efb46b-0fc2-4032-97d6-0ca0304c5ad1 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-22efb46b-0fc2-4032-97d6-0ca0304c5ad1 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:04 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:46:04 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:04 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dabf9c4b-271a-4c30-8266-7d8d56f8fcc9 Nov 03 07:46:04 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:04 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f17b6e8c-26f9-4446-80c7-3141494221c3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c" returned: 0 in 0.592s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f17b6e8c-26f9-4446-80c7-3141494221c3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:04 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c Nov 03 07:46:04 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e4f1aac-59ee-42be-bca6-6572ac06a8cb {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:04 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e4f1aac-59ee-42be-bca6-6572ac06a8cb Nov 03 07:46:04 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:04 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-22efb46b-0fc2-4032-97d6-0ca0304c5ad1 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.331s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-22efb46b-0fc2-4032-97d6-0ca0304c5ad1 tempest-ProjectMemberTests-2017513802 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:04 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-22efb46b-0fc2-4032-97d6-0ca0304c5ad1 tempest-ProjectMemberTests-2017513802 None] Deleted volume successfully. Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-22efb46b-0fc2-4032-97d6-0ca0304c5ad1 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-62000db1-f443-4429-b67d-3cf2ed3dac53-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:04 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b0bd727f-7932-48c7-a0a4-13964fec4faf tempest-ProjectReaderTests-797494389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dabf9c4b-271a-4c30-8266-7d8d56f8fcc9" returned: 0 in 0.629s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:04 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b0bd727f-7932-48c7-a0a4-13964fec4faf tempest-ProjectReaderTests-797494389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dabf9c4b-271a-4c30-8266-7d8d56f8fcc9 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f17b6e8c-26f9-4446-80c7-3141494221c3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-a8f72970-01d2-418e-a48e-c714e4481c9c" returned: 0 in 0.438s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:04 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dabf9c4b-271a-4c30-8266-7d8d56f8fcc9 Nov 03 07:46:04 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f17b6e8c-26f9-4446-80c7-3141494221c3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-quobyte-a8f72970-01d2-418e-a48e-c714e4481c9c" released by "delete_volume" :: held 1.152s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:04 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-f17b6e8c-26f9-4446-80c7-3141494221c3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Created reservations ['c03de6e5-5607-462e-977c-1765101ba917', '218bbc98-e782-412f-8c84-c9f4460e8b52', '6cfdca59-4803-4b0e-bb75-82b1fa086488', 'dcea366e-42a4-4a47-9cf6-7b6402237837'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e4f1aac-59ee-42be-bca6-6572ac06a8cb" returned: 0 in 0.373s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:46:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Attempting download of 5e116e2a-e358-4024-868b-7f3c27a84125 ((None, [{'url': 'file:///opt/stack/data/glance/images/5e116e2a-e358-4024-868b-7f3c27a84125', 'metadata': {}}])) to volume 4e4f1aac-59ee-42be-bca6-6572ac06a8cb. {{(pid=87016) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f17b6e8c-26f9-4446-80c7-3141494221c3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f17b6e8c-26f9-4446-80c7-3141494221c3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f17b6e8c-26f9-4446-80c7-3141494221c3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f17b6e8c-26f9-4446-80c7-3141494221c3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f17b6e8c-26f9-4446-80c7-3141494221c3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f17b6e8c-26f9-4446-80c7-3141494221c3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:05 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:46:05 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d404345-cc28-4ebe-8a31-5de589e86c43]: (4, 'raw') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5e116e2a-e358-4024-868b-7f3c27a84125_6i1nupml {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:05 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b0bd727f-7932-48c7-a0a4-13964fec4faf tempest-ProjectReaderTests-797494389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-dabf9c4b-271a-4c30-8266-7d8d56f8fcc9" returned: 0 in 0.356s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b0bd727f-7932-48c7-a0a4-13964fec4faf tempest-ProjectReaderTests-797494389 None] Lock "cinder-quobyte-dabf9c4b-271a-4c30-8266-7d8d56f8fcc9" released by "delete_volume" :: held 1.069s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:05 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5e116e2a-e358-4024-868b-7f3c27a84125_6i1nupml Nov 03 07:46:05 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Flow 'volume_create_manager' (a70b5586-814f-47bb-80a8-9b60f819c981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9e9890-983d-4726-bf07-19ff2ff88972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9e9890-983d-4726-bf07-19ff2ff88972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-549677190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1439c1b-abe2-45b6-8a46-c8c37fb6ae64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed98c25bc1c64da3a0227cf8c7bef103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:05Z,use_quota=True,user_id='3b3ce7b9c2864a2db5285861bf4701c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d7aa12-0557-4a2c-8d93-20740cc10696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d7aa12-0557-4a2c-8d93-20740cc10696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7744b11-aeea-44f5-be76-eba62f3f04fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7744b11-aeea-44f5-be76-eba62f3f04fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1439c1b-abe2-45b6-8a46-c8c37fb6ae64', 'volume_name': 'volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4136ef45-3736-45c4-bcfd-82333d780f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4136ef45-3736-45c4-bcfd-82333d780f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:05 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245331d0-b71e-4a80-a4f2-b5eb49e892b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:05 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Volume c1439c1b-abe2-45b6-8a46-c8c37fb6ae64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64', 'volume_size': 1} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-549677190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1439c1b-abe2-45b6-8a46-c8c37fb6ae64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed98c25bc1c64da3a0227cf8c7bef103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:05Z,use_quota=True,user_id='3b3ce7b9c2864a2db5285861bf4701c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Creating volume c1439c1b-abe2-45b6-8a46-c8c37fb6ae64 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:05 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f17b6e8c-26f9-4446-80c7-3141494221c3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.333s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-f17b6e8c-26f9-4446-80c7-3141494221c3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:05 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64 1073741824 Nov 03 07:46:05 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:05 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-f17b6e8c-26f9-4446-80c7-3141494221c3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Deleted volume successfully. Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-b0bd727f-7932-48c7-a0a4-13964fec4faf tempest-ProjectReaderTests-797494389 None] Created reservations ['0cad146c-aced-46b2-938f-dd5099d202bd', '7c8c71c1-8991-4b59-86ec-013c007b132e', '44aabf1f-e00c-4b03-9e09-18b350d7b3b6', '63a2a0e5-722a-469c-b43c-3584d5420b25'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f17b6e8c-26f9-4446-80c7-3141494221c3 tempest-CreateVolumesFromSnapshotTest-1376318347 None] Lock "cinder-a8f72970-01d2-418e-a48e-c714e4481c9c-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b0bd727f-7932-48c7-a0a4-13964fec4faf tempest-ProjectReaderTests-797494389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b0bd727f-7932-48c7-a0a4-13964fec4faf tempest-ProjectReaderTests-797494389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b0bd727f-7932-48c7-a0a4-13964fec4faf tempest-ProjectReaderTests-797494389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b0bd727f-7932-48c7-a0a4-13964fec4faf tempest-ProjectReaderTests-797494389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b0bd727f-7932-48c7-a0a4-13964fec4faf tempest-ProjectReaderTests-797494389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b0bd727f-7932-48c7-a0a4-13964fec4faf tempest-ProjectReaderTests-797494389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:05 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5e116e2a-e358-4024-868b-7f3c27a84125_6i1nupml" returned: 0 in 0.411s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5e116e2a-e358-4024-868b-7f3c27a84125_6i1nupml {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:05 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:46:05 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:05 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5e116e2a-e358-4024-868b-7f3c27a84125_6i1nupml Nov 03 07:46:05 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:05 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64 1073741824" returned: 0 in 0.428s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:05 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b0bd727f-7932-48c7-a0a4-13964fec4faf tempest-ProjectReaderTests-797494389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.385s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:05 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-b0bd727f-7932-48c7-a0a4-13964fec4faf tempest-ProjectReaderTests-797494389 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:05 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64 Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5e116e2a-e358-4024-868b-7f3c27a84125_6i1nupml" returned: 1 in 0.365s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:05 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5e116e2a-e358-4024-868b-7f3c27a84125_6i1nupml' failed. Not Retrying. {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5115c83-d127-4336-b809-01d4c0212269]: (4, 'raw') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:05 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b0bd727f-7932-48c7-a0a4-13964fec4faf tempest-ProjectReaderTests-797494389 None] Deleted volume successfully. Nov 03 07:46:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b0bd727f-7932-48c7-a0a4-13964fec4faf tempest-ProjectReaderTests-797494389 None] Lock "cinder-dabf9c4b-271a-4c30-8266-7d8d56f8fcc9-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:06 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD Nov 03 07:46:06 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:06 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64" returned: 0 in 0.288s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:06 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:46:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245331d0-b71e-4a80-a4f2-b5eb49e892b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c458e7-9e55-48df-9b5b-7b4cfdd37fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:06 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Volume volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64 (c1439c1b-abe2-45b6-8a46-c8c37fb6ae64): created successfully Nov 03 07:46:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c458e7-9e55-48df-9b5b-7b4cfdd37fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Flow 'volume_create_manager' (a70b5586-814f-47bb-80a8-9b60f819c981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:06 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-700195d9-2fa2-4abb-95ec-2bf588c7522d tempest-ProjectMemberTests-2017513802 None] Created volume successfully. Nov 03 07:46:06 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:06 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD Nov 03 07:46:06 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:06 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD" returned: 1 in 0.403s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:46:06 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] 5e116e2a-e358-4024-868b-7f3c27a84125 was raw, converting to qcow2 {{(pid=87016) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:46:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e4f1aac-59ee-42be-bca6-6572ac06a8cb {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:06 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e4f1aac-59ee-42be-bca6-6572ac06a8cb Nov 03 07:46:06 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:06 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Flow 'volume_create_manager' (aeb69f10-6ef6-40ae-9cec-2cebd2aeb4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c3cabf-b757-4f05-8b99-32603397222e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c3cabf-b757-4f05-8b99-32603397222e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1664347671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17053c5b-9509-4ab9-b86a-955862aacc5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d52323e76842416186d6aec6d7a88897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:07Z,use_quota=True,user_id='40b77a22c13f4e4c89ce15a331b12d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10efb87c-db77-4da0-9a0c-2d6e92002dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10efb87c-db77-4da0-9a0c-2d6e92002dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d5ee5f-4f76-4cd4-8edc-f6789907e7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d5ee5f-4f76-4cd4-8edc-f6789907e7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17053c5b-9509-4ab9-b86a-955862aacc5d', 'volume_name': 'volume-17053c5b-9509-4ab9-b86a-955862aacc5d', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292fe621-0484-4cf4-b787-c1b43751af60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292fe621-0484-4cf4-b787-c1b43751af60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ebc20b-b3e5-4824-a9da-64456d1c1058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:07 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Volume 17053c5b-9509-4ab9-b86a-955862aacc5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17053c5b-9509-4ab9-b86a-955862aacc5d', 'volume_size': 1} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1664347671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17053c5b-9509-4ab9-b86a-955862aacc5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d52323e76842416186d6aec6d7a88897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:07Z,use_quota=True,user_id='40b77a22c13f4e4c89ce15a331b12d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Creating volume 17053c5b-9509-4ab9-b86a-955862aacc5d {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:07 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-17053c5b-9509-4ab9-b86a-955862aacc5d 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:07 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-17053c5b-9509-4ab9-b86a-955862aacc5d 1073741824 Nov 03 07:46:07 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:07 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e4f1aac-59ee-42be-bca6-6572ac06a8cb" returned: 0 in 0.632s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5e116e2a-e358-4024-868b-7f3c27a84125_zje4xsqfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e4f1aac-59ee-42be-bca6-6572ac06a8cb {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:46:07 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e4f1aac-59ee-42be-bca6-6572ac06a8cb 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:07 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e4f1aac-59ee-42be-bca6-6572ac06a8cb 1G Nov 03 07:46:07 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e26bfa98-e2f2-4a0b-a657-3c9680b9e0ec tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:07 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-17053c5b-9509-4ab9-b86a-955862aacc5d 1073741824" returned: 0 in 0.674s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-17053c5b-9509-4ab9-b86a-955862aacc5d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:07 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-17053c5b-9509-4ab9-b86a-955862aacc5d Nov 03 07:46:07 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:07 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e4f1aac-59ee-42be-bca6-6572ac06a8cb 1G" returned: 0 in 0.446s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Downloaded image 5e116e2a-e358-4024-868b-7f3c27a84125 ((None, [{'url': 'file:///opt/stack/data/glance/images/5e116e2a-e358-4024-868b-7f3c27a84125', 'metadata': {}}])) to volume 4e4f1aac-59ee-42be-bca6-6572ac06a8cb successfully. {{(pid=87016) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Temporary image 5e116e2a-e358-4024-868b-7f3c27a84125 for user 77dcc1879c614981b88c9855ca6cf158 is deleted. {{(pid=87016) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG cinder.volume.volume_utils [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Marking volume 4e4f1aac-59ee-42be-bca6-6572ac06a8cb as bootable. {{(pid=87016) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Copying metadata from image 5e116e2a-e358-4024-868b-7f3c27a84125 to 4e4f1aac-59ee-42be-bca6-6572ac06a8cb. {{(pid=87016) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Creating volume glance metadata for volume 4e4f1aac-59ee-42be-bca6-6572ac06a8cb backed by image 5e116e2a-e358-4024-868b-7f3c27a84125 with: {'image_id': '5e116e2a-e358-4024-868b-7f3c27a84125', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9712c3b855394bcdcff7d20a0c7337cd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87016) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b713e5-ad0f-4d55-a2e7-05da224bbbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e4f1aac-59ee-42be-bca6-6572ac06a8cb', 'volume_size': 1, 'image_id': '5e116e2a-e358-4024-868b-7f3c27a84125', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5e116e2a-e358-4024-868b-7f3c27a84125', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9712c3b855394bcdcff7d20a0c7337cd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4c534131db87436e9ea3e776fb294977', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e82946451560849d62f121e267077b8c9a79df4822005eaea5a881cd1ec9e8a69206c17599a0aeb8a4929338b4191af63d61e89ccdc56504e0ef60663552e1ff', 'id': '5e116e2a-e358-4024-868b-7f3c27a84125', 'created_at': datetime.datetime(2026, 11, 3, 6, 45, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 45, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5e116e2a-e358-4024-868b-7f3c27a84125/file', 'properties': {}}, 'image_service': }' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad137211-4071-4ba6-b604-c366fda5b0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:07 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Volume volume-4e4f1aac-59ee-42be-bca6-6572ac06a8cb (4e4f1aac-59ee-42be-bca6-6572ac06a8cb): created successfully Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad137211-4071-4ba6-b604-c366fda5b0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:07 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Flow 'volume_create_manager' (0bde2919-4d47-4287-a5ee-409cd36a1e12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:08 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b8ddc187-6263-41fa-9e0f-b6aaa0820d94 tempest-VolumeImageDependencyTests-2095836631 None] Created volume successfully. Nov 03 07:46:08 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-17053c5b-9509-4ab9-b86a-955862aacc5d" returned: 0 in 0.290s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:46:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e26bfa98-e2f2-4a0b-a657-3c9680b9e0ec tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.393s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-e26bfa98-e2f2-4a0b-a657-3c9680b9e0ec tempest-ProjectMemberTests-2017513802 None] Creating offline snapshot d5e9c690-ad4c-4b15-bdb3-33b011359104 of volume c1439c1b-abe2-45b6-8a46-c8c37fb6ae64 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:46:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ebc20b-b3e5-4824-a9da-64456d1c1058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17053c5b-9509-4ab9-b86a-955862aacc5d', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0325cced-3f1b-4919-b2b5-733577268bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:08 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[5117d0cc-50ff-44f2-a4a1-69f7858e6d3c]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e26bfa98-e2f2-4a0b-a657-3c9680b9e0ec tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:08 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Volume volume-17053c5b-9509-4ab9-b86a-955862aacc5d (17053c5b-9509-4ab9-b86a-955862aacc5d): created successfully Nov 03 07:46:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0325cced-3f1b-4919-b2b5-733577268bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:08 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Flow 'volume_create_manager' (aeb69f10-6ef6-40ae-9cec-2cebd2aeb4cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:08 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-5fdf2aa5-dc37-4142-b851-567842591fd0 tempest-ProjectReaderTests-797494389 None] Created volume successfully. Nov 03 07:46:08 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64 Nov 03 07:46:08 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:08 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e26bfa98-e2f2-4a0b-a657-3c9680b9e0ec tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64" returned: 0 in 0.396s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e26bfa98-e2f2-4a0b-a657-3c9680b9e0ec tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.d5e9c690-ad4c-4b15-bdb3-33b011359104 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:08 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.d5e9c690-ad4c-4b15-bdb3-33b011359104 1G Nov 03 07:46:08 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:08 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a625bd5a-a6b0-441d-bbb6-996ad040572d tempest-VolumeImageDependencyTests-2095836631 None] Acquiring lock "cinder-4e4f1aac-59ee-42be-bca6-6572ac06a8cb-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:08 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a625bd5a-a6b0-441d-bbb6-996ad040572d tempest-VolumeImageDependencyTests-2095836631 None] Lock "cinder-4e4f1aac-59ee-42be-bca6-6572ac06a8cb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:08 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a625bd5a-a6b0-441d-bbb6-996ad040572d tempest-VolumeImageDependencyTests-2095836631 None] Acquiring lock "cinder-quobyte-4e4f1aac-59ee-42be-bca6-6572ac06a8cb" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:08 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a625bd5a-a6b0-441d-bbb6-996ad040572d tempest-VolumeImageDependencyTests-2095836631 None] Lock "cinder-quobyte-4e4f1aac-59ee-42be-bca6-6572ac06a8cb" acquired by "delete_volume" :: waited 0.016s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:08 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[e459646f-95ab-4876-add9-fd320b942a27]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a625bd5a-a6b0-441d-bbb6-996ad040572d tempest-VolumeImageDependencyTests-2095836631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e4f1aac-59ee-42be-bca6-6572ac06a8cb {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:08 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e4f1aac-59ee-42be-bca6-6572ac06a8cb Nov 03 07:46:08 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:08 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e26bfa98-e2f2-4a0b-a657-3c9680b9e0ec tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.d5e9c690-ad4c-4b15-bdb3-33b011359104 1G" returned: 0 in 0.520s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e26bfa98-e2f2-4a0b-a657-3c9680b9e0ec tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.d5e9c690-ad4c-4b15-bdb3-33b011359104 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:09 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.d5e9c690-ad4c-4b15-bdb3-33b011359104 Nov 03 07:46:09 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-279b84f5-3256-4c80-b4dc-0c3bf4e3d6e9 tempest-ProjectReaderTests-797494389 None] Acquiring lock "cinder-17053c5b-9509-4ab9-b86a-955862aacc5d-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-279b84f5-3256-4c80-b4dc-0c3bf4e3d6e9 tempest-ProjectReaderTests-797494389 None] Lock "cinder-17053c5b-9509-4ab9-b86a-955862aacc5d-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-279b84f5-3256-4c80-b4dc-0c3bf4e3d6e9 tempest-ProjectReaderTests-797494389 None] Acquiring lock "cinder-quobyte-17053c5b-9509-4ab9-b86a-955862aacc5d" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-279b84f5-3256-4c80-b4dc-0c3bf4e3d6e9 tempest-ProjectReaderTests-797494389 None] Lock "cinder-quobyte-17053c5b-9509-4ab9-b86a-955862aacc5d" acquired by "delete_volume" :: waited 0.028s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[377af9f1-287c-4f7a-8e24-086b0dde9bb5]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-279b84f5-3256-4c80-b4dc-0c3bf4e3d6e9 tempest-ProjectReaderTests-797494389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-17053c5b-9509-4ab9-b86a-955862aacc5d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:09 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a625bd5a-a6b0-441d-bbb6-996ad040572d tempest-VolumeImageDependencyTests-2095836631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e4f1aac-59ee-42be-bca6-6572ac06a8cb" returned: 0 in 0.537s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a625bd5a-a6b0-441d-bbb6-996ad040572d tempest-VolumeImageDependencyTests-2095836631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e4f1aac-59ee-42be-bca6-6572ac06a8cb {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:09 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e4f1aac-59ee-42be-bca6-6572ac06a8cb Nov 03 07:46:09 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:09 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-17053c5b-9509-4ab9-b86a-955862aacc5d Nov 03 07:46:09 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:09 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e26bfa98-e2f2-4a0b-a657-3c9680b9e0ec tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.d5e9c690-ad4c-4b15-bdb3-33b011359104" returned: 0 in 0.457s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:09 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-e26bfa98-e2f2-4a0b-a657-3c9680b9e0ec tempest-ProjectMemberTests-2017513802 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.d5e9c690-ad4c-4b15-bdb3-33b011359104 is being set with open permissions: ugo+rw Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e26bfa98-e2f2-4a0b-a657-3c9680b9e0ec tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.d5e9c690-ad4c-4b15-bdb3-33b011359104 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:09 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.d5e9c690-ad4c-4b15-bdb3-33b011359104 Nov 03 07:46:09 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:09 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a625bd5a-a6b0-441d-bbb6-996ad040572d tempest-VolumeImageDependencyTests-2095836631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4e4f1aac-59ee-42be-bca6-6572ac06a8cb" returned: 0 in 0.304s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a625bd5a-a6b0-441d-bbb6-996ad040572d tempest-VolumeImageDependencyTests-2095836631 None] Lock "cinder-quobyte-4e4f1aac-59ee-42be-bca6-6572ac06a8cb" released by "delete_volume" :: held 0.886s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-a625bd5a-a6b0-441d-bbb6-996ad040572d tempest-VolumeImageDependencyTests-2095836631 None] Created reservations ['24f8c546-42a1-4589-ace2-6498e42ed0a5', '258fcf12-7019-4508-928d-b9cb9bab9294', '03470aca-4e68-410b-93e3-f4eca17f502c', 'b1024072-f958-479d-9c16-728f80de35ad'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:09 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-279b84f5-3256-4c80-b4dc-0c3bf4e3d6e9 tempest-ProjectReaderTests-797494389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-17053c5b-9509-4ab9-b86a-955862aacc5d" returned: 0 in 0.474s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-279b84f5-3256-4c80-b4dc-0c3bf4e3d6e9 tempest-ProjectReaderTests-797494389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-17053c5b-9509-4ab9-b86a-955862aacc5d {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:09 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:09 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-17053c5b-9509-4ab9-b86a-955862aacc5d Nov 03 07:46:09 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e26bfa98-e2f2-4a0b-a657-3c9680b9e0ec tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.d5e9c690-ad4c-4b15-bdb3-33b011359104" returned: 0 in 0.342s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a625bd5a-a6b0-441d-bbb6-996ad040572d tempest-VolumeImageDependencyTests-2095836631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a625bd5a-a6b0-441d-bbb6-996ad040572d tempest-VolumeImageDependencyTests-2095836631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a625bd5a-a6b0-441d-bbb6-996ad040572d tempest-VolumeImageDependencyTests-2095836631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a625bd5a-a6b0-441d-bbb6-996ad040572d tempest-VolumeImageDependencyTests-2095836631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a625bd5a-a6b0-441d-bbb6-996ad040572d tempest-VolumeImageDependencyTests-2095836631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a625bd5a-a6b0-441d-bbb6-996ad040572d tempest-VolumeImageDependencyTests-2095836631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e26bfa98-e2f2-4a0b-a657-3c9680b9e0ec tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:09 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:46:09 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:09 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.info Nov 03 07:46:09 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:10 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e26bfa98-e2f2-4a0b-a657-3c9680b9e0ec tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.info" returned: 0 in 0.294s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:10 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-e26bfa98-e2f2-4a0b-a657-3c9680b9e0ec tempest-ProjectMemberTests-2017513802 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.info is being set with open permissions: ugo+rw Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e26bfa98-e2f2-4a0b-a657-3c9680b9e0ec tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:10 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a625bd5a-a6b0-441d-bbb6-996ad040572d tempest-VolumeImageDependencyTests-2095836631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.363s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a625bd5a-a6b0-441d-bbb6-996ad040572d tempest-VolumeImageDependencyTests-2095836631 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:10 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.info Nov 03 07:46:10 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:10 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a625bd5a-a6b0-441d-bbb6-996ad040572d tempest-VolumeImageDependencyTests-2095836631 None] Deleted volume successfully. Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a625bd5a-a6b0-441d-bbb6-996ad040572d tempest-VolumeImageDependencyTests-2095836631 None] Lock "cinder-4e4f1aac-59ee-42be-bca6-6572ac06a8cb-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:10 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-279b84f5-3256-4c80-b4dc-0c3bf4e3d6e9 tempest-ProjectReaderTests-797494389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-17053c5b-9509-4ab9-b86a-955862aacc5d" returned: 0 in 0.563s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-279b84f5-3256-4c80-b4dc-0c3bf4e3d6e9 tempest-ProjectReaderTests-797494389 None] Lock "cinder-quobyte-17053c5b-9509-4ab9-b86a-955862aacc5d" released by "delete_volume" :: held 1.088s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-279b84f5-3256-4c80-b4dc-0c3bf4e3d6e9 tempest-ProjectReaderTests-797494389 None] Created reservations ['6caa042b-41f2-4e2a-a86c-b52cab60a664', '8943c8c1-1ea1-42aa-8b5f-cee229083a79', '2447343c-8293-4d7a-a2d9-bcee33ea9baf', '00da66d6-de18-4104-a7cc-fb10b916a7c1'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:10 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e26bfa98-e2f2-4a0b-a657-3c9680b9e0ec tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.info" returned: 0 in 0.309s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e26bfa98-e2f2-4a0b-a657-3c9680b9e0ec tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.446s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:10 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-e26bfa98-e2f2-4a0b-a657-3c9680b9e0ec tempest-ProjectMemberTests-2017513802 None] Create snapshot completed successfully Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-279b84f5-3256-4c80-b4dc-0c3bf4e3d6e9 tempest-ProjectReaderTests-797494389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-279b84f5-3256-4c80-b4dc-0c3bf4e3d6e9 tempest-ProjectReaderTests-797494389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-279b84f5-3256-4c80-b4dc-0c3bf4e3d6e9 tempest-ProjectReaderTests-797494389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-279b84f5-3256-4c80-b4dc-0c3bf4e3d6e9 tempest-ProjectReaderTests-797494389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-279b84f5-3256-4c80-b4dc-0c3bf4e3d6e9 tempest-ProjectReaderTests-797494389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-279b84f5-3256-4c80-b4dc-0c3bf4e3d6e9 tempest-ProjectReaderTests-797494389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:10 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:46:10 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-be3ff065-fc75-4dd7-9e3c-7cdcd08a2c60 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-d5e9c690-ad4c-4b15-bdb3-33b011359104-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-be3ff065-fc75-4dd7-9e3c-7cdcd08a2c60 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-d5e9c690-ad4c-4b15-bdb3-33b011359104-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-be3ff065-fc75-4dd7-9e3c-7cdcd08a2c60 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:10 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-279b84f5-3256-4c80-b4dc-0c3bf4e3d6e9 tempest-ProjectReaderTests-797494389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.300s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-be3ff065-fc75-4dd7-9e3c-7cdcd08a2c60 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-be3ff065-fc75-4dd7-9e3c-7cdcd08a2c60 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-d5e9c690-ad4c-4b15-bdb3-33b011359104" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-279b84f5-3256-4c80-b4dc-0c3bf4e3d6e9 tempest-ProjectReaderTests-797494389 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:10 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-279b84f5-3256-4c80-b4dc-0c3bf4e3d6e9 tempest-ProjectReaderTests-797494389 None] Deleted volume successfully. Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-be3ff065-fc75-4dd7-9e3c-7cdcd08a2c60 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-d5e9c690-ad4c-4b15-bdb3-33b011359104" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-be3ff065-fc75-4dd7-9e3c-7cdcd08a2c60 tempest-ProjectMemberTests-2017513802 None] Deleting offline snapshot d5e9c690-ad4c-4b15-bdb3-33b011359104 of volume c1439c1b-abe2-45b6-8a46-c8c37fb6ae64 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-be3ff065-fc75-4dd7-9e3c-7cdcd08a2c60 tempest-ProjectMemberTests-2017513802 None] snapshot_file for this snap is: volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.d5e9c690-ad4c-4b15-bdb3-33b011359104 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-279b84f5-3256-4c80-b4dc-0c3bf4e3d6e9 tempest-ProjectReaderTests-797494389 None] Lock "cinder-17053c5b-9509-4ab9-b86a-955862aacc5d-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba03517-2428-490f-ac08-82e3c3497515]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:10 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-be3ff065-fc75-4dd7-9e3c-7cdcd08a2c60 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.d5e9c690-ad4c-4b15-bdb3-33b011359104 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:11 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.d5e9c690-ad4c-4b15-bdb3-33b011359104 Nov 03 07:46:11 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:11 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-be3ff065-fc75-4dd7-9e3c-7cdcd08a2c60 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.d5e9c690-ad4c-4b15-bdb3-33b011359104" returned: 0 in 0.461s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:11 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-be3ff065-fc75-4dd7-9e3c-7cdcd08a2c60 tempest-ProjectMemberTests-2017513802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:46:11 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[7366c3af-2751-4368-a718-c557098f6d0f]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-be3ff065-fc75-4dd7-9e3c-7cdcd08a2c60 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:11 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64 Nov 03 07:46:11 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:12 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-be3ff065-fc75-4dd7-9e3c-7cdcd08a2c60 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64" returned: 0 in 0.602s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-be3ff065-fc75-4dd7-9e3c-7cdcd08a2c60 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.d5e9c690-ad4c-4b15-bdb3-33b011359104 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:12 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.d5e9c690-ad4c-4b15-bdb3-33b011359104 Nov 03 07:46:12 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Flow 'volume_create_manager' (aad69f2d-6933-4e3d-82a7-26a5f3e69fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa22604-3a61-4c71-b16a-f87be7a4c66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa22604-3a61-4c71-b16a-f87be7a4c66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1425629123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d76056-d014-44ac-a66e-7224a08a18d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d52323e76842416186d6aec6d7a88897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:12Z,use_quota=True,user_id='40b77a22c13f4e4c89ce15a331b12d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b335444-a11c-4bef-8053-534118fd4b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b335444-a11c-4bef-8053-534118fd4b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f5cbf41-5575-478b-be73-6bc0f70dafce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f5cbf41-5575-478b-be73-6bc0f70dafce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7d76056-d014-44ac-a66e-7224a08a18d8', 'volume_name': 'volume-f7d76056-d014-44ac-a66e-7224a08a18d8', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b62c00e-ddc2-4609-a140-c1cc55e7f004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b62c00e-ddc2-4609-a140-c1cc55e7f004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (751fd616-bb10-4ca2-b71a-6df827cf676b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:12 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Volume f7d76056-d014-44ac-a66e-7224a08a18d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7d76056-d014-44ac-a66e-7224a08a18d8', 'volume_size': 1} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1425629123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d76056-d014-44ac-a66e-7224a08a18d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d52323e76842416186d6aec6d7a88897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:12Z,use_quota=True,user_id='40b77a22c13f4e4c89ce15a331b12d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Creating volume f7d76056-d014-44ac-a66e-7224a08a18d8 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:12 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f7d76056-d014-44ac-a66e-7224a08a18d8 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:12 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f7d76056-d014-44ac-a66e-7224a08a18d8 1073741824 Nov 03 07:46:12 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:12 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-be3ff065-fc75-4dd7-9e3c-7cdcd08a2c60 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.d5e9c690-ad4c-4b15-bdb3-33b011359104" returned: 0 in 0.477s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-be3ff065-fc75-4dd7-9e3c-7cdcd08a2c60 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.d5e9c690-ad4c-4b15-bdb3-33b011359104 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:12 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.d5e9c690-ad4c-4b15-bdb3-33b011359104 Nov 03 07:46:12 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:12 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f7d76056-d014-44ac-a66e-7224a08a18d8 1073741824" returned: 0 in 0.578s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f7d76056-d014-44ac-a66e-7224a08a18d8 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:12 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-be3ff065-fc75-4dd7-9e3c-7cdcd08a2c60 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64.d5e9c690-ad4c-4b15-bdb3-33b011359104" returned: 0 in 0.352s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:12 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f7d76056-d014-44ac-a66e-7224a08a18d8 Nov 03 07:46:12 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-be3ff065-fc75-4dd7-9e3c-7cdcd08a2c60 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-d5e9c690-ad4c-4b15-bdb3-33b011359104" released by "_delete_snapshot" :: held 2.051s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-be3ff065-fc75-4dd7-9e3c-7cdcd08a2c60 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64" released by "delete_snapshot" :: held 2.094s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:13 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-be3ff065-fc75-4dd7-9e3c-7cdcd08a2c60 tempest-ProjectMemberTests-2017513802 None] Created reservations ['117bd7a3-7d83-4cf4-930b-5ce830faeadb', '80efecc0-d05f-456a-a46c-0e1ac100b9b0', 'f79550eb-f6b5-4803-9de2-f45797246f84', 'd453d333-e6e9-48f6-81f2-540d23f7e66f'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:13 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-be3ff065-fc75-4dd7-9e3c-7cdcd08a2c60 tempest-ProjectMemberTests-2017513802 None] Delete snapshot completed successfully. Nov 03 07:46:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-be3ff065-fc75-4dd7-9e3c-7cdcd08a2c60 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-d5e9c690-ad4c-4b15-bdb3-33b011359104-delete_snapshot" released by "delete_snapshot" :: held 2.313s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:13 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f7d76056-d014-44ac-a66e-7224a08a18d8" returned: 0 in 0.366s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:13 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:46:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (751fd616-bb10-4ca2-b71a-6df827cf676b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7d76056-d014-44ac-a66e-7224a08a18d8', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eddaf084-3201-4b6d-9f00-547b00fb955b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:13 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Volume volume-f7d76056-d014-44ac-a66e-7224a08a18d8 (f7d76056-d014-44ac-a66e-7224a08a18d8): created successfully Nov 03 07:46:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eddaf084-3201-4b6d-9f00-547b00fb955b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:13 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Flow 'volume_create_manager' (aad69f2d-6933-4e3d-82a7-26a5f3e69fed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:13 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-5351a091-2116-481d-843e-14eae2c96db1 tempest-ProjectReaderTests-797494389 None] Created volume successfully. Nov 03 07:46:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-87326548-f60d-4ff4-84af-0d21d616ed98 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-87326548-f60d-4ff4-84af-0d21d616ed98 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-38ecb73f-eece-4227-a03f-9541eba3a06f tempest-ProjectReaderTests-797494389 None] Acquiring lock "cinder-f7d76056-d014-44ac-a66e-7224a08a18d8-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-87326548-f60d-4ff4-84af-0d21d616ed98 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:14 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-7fbcb4fd-e296-4c11-b8ea-381456c73c1c tempest-ProjectAdminTests-1501998638 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7531204223633, 'free_capacity_gb': 1773.7531204223633, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87016) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 07:46:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-38ecb73f-eece-4227-a03f-9541eba3a06f tempest-ProjectReaderTests-797494389 None] Lock "cinder-f7d76056-d014-44ac-a66e-7224a08a18d8-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-87326548-f60d-4ff4-84af-0d21d616ed98 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64" acquired by "delete_volume" :: waited 0.058s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:14 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c75a577-ec66-4008-8651-f03206fd0630]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-87326548-f60d-4ff4-84af-0d21d616ed98 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-38ecb73f-eece-4227-a03f-9541eba3a06f tempest-ProjectReaderTests-797494389 None] Acquiring lock "cinder-quobyte-f7d76056-d014-44ac-a66e-7224a08a18d8" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-38ecb73f-eece-4227-a03f-9541eba3a06f tempest-ProjectReaderTests-797494389 None] Lock "cinder-quobyte-f7d76056-d014-44ac-a66e-7224a08a18d8" acquired by "delete_volume" :: waited 0.022s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:14 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[807cab34-484a-4c49-aaa7-3bbaa6fd9784]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-38ecb73f-eece-4227-a03f-9541eba3a06f tempest-ProjectReaderTests-797494389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f7d76056-d014-44ac-a66e-7224a08a18d8 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:14 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64 Nov 03 07:46:14 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:14 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f7d76056-d014-44ac-a66e-7224a08a18d8 Nov 03 07:46:14 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:14 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-87326548-f60d-4ff4-84af-0d21d616ed98 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64" returned: 0 in 0.518s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-87326548-f60d-4ff4-84af-0d21d616ed98 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:14 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64 Nov 03 07:46:14 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:15 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-38ecb73f-eece-4227-a03f-9541eba3a06f tempest-ProjectReaderTests-797494389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f7d76056-d014-44ac-a66e-7224a08a18d8" returned: 0 in 0.514s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-38ecb73f-eece-4227-a03f-9541eba3a06f tempest-ProjectReaderTests-797494389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f7d76056-d014-44ac-a66e-7224a08a18d8 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:15 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f7d76056-d014-44ac-a66e-7224a08a18d8 Nov 03 07:46:15 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:15 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-87326548-f60d-4ff4-84af-0d21d616ed98 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64" returned: 0 in 0.461s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-87326548-f60d-4ff4-84af-0d21d616ed98 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64" released by "delete_volume" :: held 1.113s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:15 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-38ecb73f-eece-4227-a03f-9541eba3a06f tempest-ProjectReaderTests-797494389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-f7d76056-d014-44ac-a66e-7224a08a18d8" returned: 0 in 0.459s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:15 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-38ecb73f-eece-4227-a03f-9541eba3a06f tempest-ProjectReaderTests-797494389 None] Lock "cinder-quobyte-f7d76056-d014-44ac-a66e-7224a08a18d8" released by "delete_volume" :: held 1.048s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:15 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-87326548-f60d-4ff4-84af-0d21d616ed98 tempest-ProjectMemberTests-2017513802 None] Created reservations ['b708471a-94f2-47f6-9463-a0e9413dc1b9', '4beb5882-fed5-47bd-8d3f-93f44b4e729b', 'fedb2391-8495-493d-ab67-b7ee126cd91a', '64524e48-2e91-40fc-acdd-8b79a1136c14'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:15 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-38ecb73f-eece-4227-a03f-9541eba3a06f tempest-ProjectReaderTests-797494389 None] Created reservations ['09db4096-3978-4a27-9ba8-bd33da73a0e4', 'b66ba85b-6bbb-49db-84e6-1987587fe146', 'a9bc68b2-331a-4236-b71c-6addea220408', '145c51ce-17f7-43aa-9e55-d5487a0c9f13'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-87326548-f60d-4ff4-84af-0d21d616ed98 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-87326548-f60d-4ff4-84af-0d21d616ed98 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-87326548-f60d-4ff4-84af-0d21d616ed98 tempest-ProjectMemberTests-2017513802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-87326548-f60d-4ff4-84af-0d21d616ed98 tempest-ProjectMemberTests-2017513802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-87326548-f60d-4ff4-84af-0d21d616ed98 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-87326548-f60d-4ff4-84af-0d21d616ed98 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:15 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:46:15 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-38ecb73f-eece-4227-a03f-9541eba3a06f tempest-ProjectReaderTests-797494389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-38ecb73f-eece-4227-a03f-9541eba3a06f tempest-ProjectReaderTests-797494389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-38ecb73f-eece-4227-a03f-9541eba3a06f tempest-ProjectReaderTests-797494389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:15 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-38ecb73f-eece-4227-a03f-9541eba3a06f tempest-ProjectReaderTests-797494389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-38ecb73f-eece-4227-a03f-9541eba3a06f tempest-ProjectReaderTests-797494389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:15 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-38ecb73f-eece-4227-a03f-9541eba3a06f tempest-ProjectReaderTests-797494389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:15 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:46:15 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:16 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-87326548-f60d-4ff4-84af-0d21d616ed98 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.375s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:16 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-87326548-f60d-4ff4-84af-0d21d616ed98 tempest-ProjectMemberTests-2017513802 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:16 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-87326548-f60d-4ff4-84af-0d21d616ed98 tempest-ProjectMemberTests-2017513802 None] Deleted volume successfully. Nov 03 07:46:16 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-87326548-f60d-4ff4-84af-0d21d616ed98 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-c1439c1b-abe2-45b6-8a46-c8c37fb6ae64-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:16 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:16 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-38ecb73f-eece-4227-a03f-9541eba3a06f tempest-ProjectReaderTests-797494389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.407s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:16 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-38ecb73f-eece-4227-a03f-9541eba3a06f tempest-ProjectReaderTests-797494389 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:16 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-38ecb73f-eece-4227-a03f-9541eba3a06f tempest-ProjectReaderTests-797494389 None] Deleted volume successfully. Nov 03 07:46:16 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-38ecb73f-eece-4227-a03f-9541eba3a06f tempest-ProjectReaderTests-797494389 None] Lock "cinder-f7d76056-d014-44ac-a66e-7224a08a18d8-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Flow 'volume_create_manager' (2af2e9fb-5882-4b3d-b236-64fa2da3e41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d29c3213-2879-41a0-bd3d-343fd8ffc691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d29c3213-2879-41a0-bd3d-343fd8ffc691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1321402812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b61aa4a-ce8a-41e5-8148-6687103845fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed98c25bc1c64da3a0227cf8c7bef103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:17Z,use_quota=True,user_id='3b3ce7b9c2864a2db5285861bf4701c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038177c1-2fff-46d0-aa9f-44cca47f2fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038177c1-2fff-46d0-aa9f-44cca47f2fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d459a994-b811-4062-87b4-22b620f3777c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d459a994-b811-4062-87b4-22b620f3777c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b61aa4a-ce8a-41e5-8148-6687103845fc', 'volume_name': 'volume-8b61aa4a-ce8a-41e5-8148-6687103845fc', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2250458-ce44-4e8e-86ee-6cfc0eedc672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2250458-ce44-4e8e-86ee-6cfc0eedc672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663d5f69-b000-46a3-b93a-0b318060d71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:17 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Volume 8b61aa4a-ce8a-41e5-8148-6687103845fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b61aa4a-ce8a-41e5-8148-6687103845fc', 'volume_size': 1} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1321402812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b61aa4a-ce8a-41e5-8148-6687103845fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed98c25bc1c64da3a0227cf8c7bef103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:17Z,use_quota=True,user_id='3b3ce7b9c2864a2db5285861bf4701c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Creating volume 8b61aa4a-ce8a-41e5-8148-6687103845fc {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:17 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:17 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc 1073741824 Nov 03 07:46:17 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Flow 'volume_create_manager' (4f3dc0e5-1476-4872-b2e2-8d7a3e743e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8659eca2-1ff9-48be-afb9-d8de1a615f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8659eca2-1ff9-48be-afb9-d8de1a615f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1960767656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b56379b9-41bb-49e4-8b9e-0944005e4a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d52323e76842416186d6aec6d7a88897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:17Z,use_quota=True,user_id='40b77a22c13f4e4c89ce15a331b12d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a83e677-b991-4c0b-911a-397144a4d143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a83e677-b991-4c0b-911a-397144a4d143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ddfdcc-743f-4953-99ff-eb4a80bf8f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ddfdcc-743f-4953-99ff-eb4a80bf8f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b56379b9-41bb-49e4-8b9e-0944005e4a8a', 'volume_name': 'volume-b56379b9-41bb-49e4-8b9e-0944005e4a8a', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e6eaf7-ac5d-427e-83e0-64ad64b3ac78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e6eaf7-ac5d-427e-83e0-64ad64b3ac78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1122eae-7177-4f5e-bf8e-06519a239652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:17 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Volume b56379b9-41bb-49e4-8b9e-0944005e4a8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b56379b9-41bb-49e4-8b9e-0944005e4a8a', 'volume_size': 1} Nov 03 07:46:17 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:18 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc 1073741824" returned: 0 in 0.586s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:18 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc Nov 03 07:46:18 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:18 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc" returned: 0 in 0.344s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:46:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.811s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1960767656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b56379b9-41bb-49e4-8b9e-0944005e4a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d52323e76842416186d6aec6d7a88897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:17Z,use_quota=True,user_id='40b77a22c13f4e4c89ce15a331b12d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:46:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Creating volume b56379b9-41bb-49e4-8b9e-0944005e4a8a {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:18 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:18 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:46:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b56379b9-41bb-49e4-8b9e-0944005e4a8a 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:18 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b56379b9-41bb-49e4-8b9e-0944005e4a8a 1073741824 Nov 03 07:46:18 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663d5f69-b000-46a3-b93a-0b318060d71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b61aa4a-ce8a-41e5-8148-6687103845fc', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cc2bdf-8a77-434c-938a-0b180bcbe6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:18 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Volume volume-8b61aa4a-ce8a-41e5-8148-6687103845fc (8b61aa4a-ce8a-41e5-8148-6687103845fc): created successfully Nov 03 07:46:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cc2bdf-8a77-434c-938a-0b180bcbe6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:18 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Flow 'volume_create_manager' (2af2e9fb-5882-4b3d-b236-64fa2da3e41f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:18 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-8be65305-a014-446b-aecd-00396e48dc76 tempest-ProjectMemberTests-2017513802 None] Created volume successfully. Nov 03 07:46:18 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b56379b9-41bb-49e4-8b9e-0944005e4a8a 1073741824" returned: 0 in 0.464s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:18 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b56379b9-41bb-49e4-8b9e-0944005e4a8a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:19 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b56379b9-41bb-49e4-8b9e-0944005e4a8a Nov 03 07:46:19 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Flow 'volume_create_manager' (dbe5a5d9-dee2-493c-abfd-be44386a990c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ffbc93b-e223-4638-9c91-cbdae43bc005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:19 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b56379b9-41bb-49e4-8b9e-0944005e4a8a" returned: 0 in 0.480s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ffbc93b-e223-4638-9c91-cbdae43bc005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-297970731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4599b1c7-1a7b-431b-be50-e7b7044f5f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d016ba9019143bca2aab18a27b1a5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:19Z,use_quota=True,user_id='a802132e9b66410dbd73f46a439c9c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c723b0-65d2-4ed7-832a-a0159af452f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c723b0-65d2-4ed7-832a-a0159af452f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cbac897-0022-40a5-9056-2c5bafcb6e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cbac897-0022-40a5-9056-2c5bafcb6e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4599b1c7-1a7b-431b-be50-e7b7044f5f6b', 'volume_name': 'volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b833e848-7fea-4f19-a595-1cdffa7be771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b833e848-7fea-4f19-a595-1cdffa7be771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e53190a8-1ff3-45c2-acb8-fc411f83e4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:19 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Volume 4599b1c7-1a7b-431b-be50-e7b7044f5f6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b', 'volume_size': 1} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-297970731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4599b1c7-1a7b-431b-be50-e7b7044f5f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d016ba9019143bca2aab18a27b1a5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:19Z,use_quota=True,user_id='a802132e9b66410dbd73f46a439c9c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Creating volume 4599b1c7-1a7b-431b-be50-e7b7044f5f6b {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:19 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1122eae-7177-4f5e-bf8e-06519a239652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b56379b9-41bb-49e4-8b9e-0944005e4a8a', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c83c284-757b-4034-9a8e-5bcb321d61e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:19 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b 1073741824 Nov 03 07:46:19 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2b93909a-be42-4ff5-9820-7733364cb0be tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:19 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Volume volume-b56379b9-41bb-49e4-8b9e-0944005e4a8a (b56379b9-41bb-49e4-8b9e-0944005e4a8a): created successfully Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c83c284-757b-4034-9a8e-5bcb321d61e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:19 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Flow 'volume_create_manager' (4f3dc0e5-1476-4872-b2e2-8d7a3e743e2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:19 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-81543696-e26b-4506-998e-3d2fa58b4a5d tempest-ProjectReaderTests-797494389 None] Created volume successfully. Nov 03 07:46:20 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b 1073741824" returned: 0 in 0.500s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:20 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b Nov 03 07:46:20 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:20 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b" returned: 0 in 0.340s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:20 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:46:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2b93909a-be42-4ff5-9820-7733364cb0be tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.856s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:20 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e53190a8-1ff3-45c2-acb8-fc411f83e4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:20 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5950758a-c7ed-4848-966d-a53a8999cd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:20 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-2b93909a-be42-4ff5-9820-7733364cb0be tempest-ProjectMemberTests-2017513802 None] Creating offline snapshot 19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36 of volume 8b61aa4a-ce8a-41e5-8148-6687103845fc {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:46:20 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Volume volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b (4599b1c7-1a7b-431b-be50-e7b7044f5f6b): created successfully Nov 03 07:46:20 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5950758a-c7ed-4848-966d-a53a8999cd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:20 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Flow 'volume_create_manager' (dbe5a5d9-dee2-493c-abfd-be44386a990c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:20 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[38630893-0221-4d76-8d42-2e347ff68f9a]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2b93909a-be42-4ff5-9820-7733364cb0be tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d40cfd4d-febe-49e5-b875-e3172a405b20 tempest-ProjectReaderTests-797494389 None] Acquiring lock "cinder-b56379b9-41bb-49e4-8b9e-0944005e4a8a-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:20 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-3f8c50c8-a561-48e4-8898-c949610c62ed tempest-ProjectReaderTests-1828620363 None] Created volume successfully. Nov 03 07:46:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d40cfd4d-febe-49e5-b875-e3172a405b20 tempest-ProjectReaderTests-797494389 None] Lock "cinder-b56379b9-41bb-49e4-8b9e-0944005e4a8a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d40cfd4d-febe-49e5-b875-e3172a405b20 tempest-ProjectReaderTests-797494389 None] Acquiring lock "cinder-quobyte-b56379b9-41bb-49e4-8b9e-0944005e4a8a" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:20 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d40cfd4d-febe-49e5-b875-e3172a405b20 tempest-ProjectReaderTests-797494389 None] Lock "cinder-quobyte-b56379b9-41bb-49e4-8b9e-0944005e4a8a" acquired by "delete_volume" :: waited 0.015s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:20 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc Nov 03 07:46:20 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:20 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc20e93-fd06-45ef-94cd-a42dcce86ac3]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d40cfd4d-febe-49e5-b875-e3172a405b20 tempest-ProjectReaderTests-797494389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b56379b9-41bb-49e4-8b9e-0944005e4a8a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:20 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b56379b9-41bb-49e4-8b9e-0944005e4a8a Nov 03 07:46:20 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:20 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2b93909a-be42-4ff5-9820-7733364cb0be tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc" returned: 0 in 0.387s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:20 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2b93909a-be42-4ff5-9820-7733364cb0be tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:20 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36 1G Nov 03 07:46:20 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:21 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d40cfd4d-febe-49e5-b875-e3172a405b20 tempest-ProjectReaderTests-797494389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b56379b9-41bb-49e4-8b9e-0944005e4a8a" returned: 0 in 0.365s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d40cfd4d-febe-49e5-b875-e3172a405b20 tempest-ProjectReaderTests-797494389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b56379b9-41bb-49e4-8b9e-0944005e4a8a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:21 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b56379b9-41bb-49e4-8b9e-0944005e4a8a Nov 03 07:46:21 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:21 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d40cfd4d-febe-49e5-b875-e3172a405b20 tempest-ProjectReaderTests-797494389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b56379b9-41bb-49e4-8b9e-0944005e4a8a" returned: 0 in 0.267s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:21 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d40cfd4d-febe-49e5-b875-e3172a405b20 tempest-ProjectReaderTests-797494389 None] Lock "cinder-quobyte-b56379b9-41bb-49e4-8b9e-0944005e4a8a" released by "delete_volume" :: held 0.678s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:21 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-d40cfd4d-febe-49e5-b875-e3172a405b20 tempest-ProjectReaderTests-797494389 None] Created reservations ['1c3cecfe-f733-4cdd-917a-dac9316294f2', '6e1f06fe-3c6e-4a46-8d99-5d63cbb10ed3', 'de3e2b95-3d47-4fbb-88ed-60369ef2c294', 'b91f57aa-e009-40a1-b776-5d6a63a7c890'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:21 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2b93909a-be42-4ff5-9820-7733364cb0be tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36 1G" returned: 0 in 0.475s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2b93909a-be42-4ff5-9820-7733364cb0be tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b61aa4a-ce8a-41e5-8148-6687103845fc -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:21 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b61aa4a-ce8a-41e5-8148-6687103845fc -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36 Nov 03 07:46:21 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d40cfd4d-febe-49e5-b875-e3172a405b20 tempest-ProjectReaderTests-797494389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d40cfd4d-febe-49e5-b875-e3172a405b20 tempest-ProjectReaderTests-797494389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d40cfd4d-febe-49e5-b875-e3172a405b20 tempest-ProjectReaderTests-797494389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:21 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d40cfd4d-febe-49e5-b875-e3172a405b20 tempest-ProjectReaderTests-797494389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d40cfd4d-febe-49e5-b875-e3172a405b20 tempest-ProjectReaderTests-797494389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d40cfd4d-febe-49e5-b875-e3172a405b20 tempest-ProjectReaderTests-797494389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:21 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:46:21 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:21 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2b93909a-be42-4ff5-9820-7733364cb0be tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b61aa4a-ce8a-41e5-8148-6687103845fc -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36" returned: 0 in 0.409s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:21 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-2b93909a-be42-4ff5-9820-7733364cb0be tempest-ProjectMemberTests-2017513802 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36 is being set with open permissions: ugo+rw Nov 03 07:46:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2b93909a-be42-4ff5-9820-7733364cb0be tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:21 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d40cfd4d-febe-49e5-b875-e3172a405b20 tempest-ProjectReaderTests-797494389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.348s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:21 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-d40cfd4d-febe-49e5-b875-e3172a405b20 tempest-ProjectReaderTests-797494389 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:21 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36 Nov 03 07:46:21 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:21 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1a41707f-425c-4806-bc11-77e3f2bc759b tempest-ProjectReaderTests-1828620363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:21 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-d40cfd4d-febe-49e5-b875-e3172a405b20 tempest-ProjectReaderTests-797494389 None] Deleted volume successfully. Nov 03 07:46:21 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d40cfd4d-febe-49e5-b875-e3172a405b20 tempest-ProjectReaderTests-797494389 None] Lock "cinder-b56379b9-41bb-49e4-8b9e-0944005e4a8a-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:22 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2b93909a-be42-4ff5-9820-7733364cb0be tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36" returned: 0 in 0.279s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2b93909a-be42-4ff5-9820-7733364cb0be tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:22 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.info Nov 03 07:46:22 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:22 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2b93909a-be42-4ff5-9820-7733364cb0be tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.info" returned: 0 in 0.285s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:22 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-2b93909a-be42-4ff5-9820-7733364cb0be tempest-ProjectMemberTests-2017513802 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.info is being set with open permissions: ugo+rw Nov 03 07:46:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2b93909a-be42-4ff5-9820-7733364cb0be tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:22 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.info Nov 03 07:46:22 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:22 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2b93909a-be42-4ff5-9820-7733364cb0be tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.info" returned: 0 in 0.262s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2b93909a-be42-4ff5-9820-7733364cb0be tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.294s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1a41707f-425c-4806-bc11-77e3f2bc759b tempest-ProjectReaderTests-1828620363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.915s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:22 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-1a41707f-425c-4806-bc11-77e3f2bc759b tempest-ProjectReaderTests-1828620363 None] Creating offline snapshot 7b1b1c8e-a3b9-462b-b69c-3968f64e75a5 of volume 4599b1c7-1a7b-431b-be50-e7b7044f5f6b {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:46:22 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-2b93909a-be42-4ff5-9820-7733364cb0be tempest-ProjectMemberTests-2017513802 None] Create snapshot completed successfully Nov 03 07:46:22 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[332f7ba3-1d4f-49fc-a2ae-2dbcfb40abca]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:22 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1a41707f-425c-4806-bc11-77e3f2bc759b tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:22 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b Nov 03 07:46:22 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:23 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1a41707f-425c-4806-bc11-77e3f2bc759b tempest-ProjectReaderTests-1828620363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b" returned: 0 in 0.438s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1a41707f-425c-4806-bc11-77e3f2bc759b tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.7b1b1c8e-a3b9-462b-b69c-3968f64e75a5 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:23 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.7b1b1c8e-a3b9-462b-b69c-3968f64e75a5 1G Nov 03 07:46:23 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:23 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-402bc443-0346-4394-bca6-f218633aa2a7 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:23 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-402bc443-0346-4394-bca6-f218633aa2a7 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:23 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-402bc443-0346-4394-bca6-f218633aa2a7 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-8b61aa4a-ce8a-41e5-8148-6687103845fc" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:23 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-402bc443-0346-4394-bca6-f218633aa2a7 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-8b61aa4a-ce8a-41e5-8148-6687103845fc" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:23 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-402bc443-0346-4394-bca6-f218633aa2a7 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:23 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-402bc443-0346-4394-bca6-f218633aa2a7 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-402bc443-0346-4394-bca6-f218633aa2a7 tempest-ProjectMemberTests-2017513802 None] Deleting offline snapshot 19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36 of volume 8b61aa4a-ce8a-41e5-8148-6687103845fc {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:46:23 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-402bc443-0346-4394-bca6-f218633aa2a7 tempest-ProjectMemberTests-2017513802 None] snapshot_file for this snap is: volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:46:23 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:23 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a5db57-267b-4dfa-aa6f-677a8b3182f9]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-402bc443-0346-4394-bca6-f218633aa2a7 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1a41707f-425c-4806-bc11-77e3f2bc759b tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.7b1b1c8e-a3b9-462b-b69c-3968f64e75a5 1G" returned: 0 in 0.607s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:23 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1a41707f-425c-4806-bc11-77e3f2bc759b tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.7b1b1c8e-a3b9-462b-b69c-3968f64e75a5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:23 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.7b1b1c8e-a3b9-462b-b69c-3968f64e75a5 Nov 03 07:46:23 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:23 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36 Nov 03 07:46:23 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:24 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1a41707f-425c-4806-bc11-77e3f2bc759b tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.7b1b1c8e-a3b9-462b-b69c-3968f64e75a5" returned: 0 in 0.397s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:24 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-1a41707f-425c-4806-bc11-77e3f2bc759b tempest-ProjectReaderTests-1828620363 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.7b1b1c8e-a3b9-462b-b69c-3968f64e75a5 is being set with open permissions: ugo+rw Nov 03 07:46:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1a41707f-425c-4806-bc11-77e3f2bc759b tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.7b1b1c8e-a3b9-462b-b69c-3968f64e75a5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:24 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.7b1b1c8e-a3b9-462b-b69c-3968f64e75a5 Nov 03 07:46:24 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:24 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-402bc443-0346-4394-bca6-f218633aa2a7 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36" returned: 0 in 0.470s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:24 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-402bc443-0346-4394-bca6-f218633aa2a7 tempest-ProjectMemberTests-2017513802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b61aa4a-ce8a-41e5-8148-6687103845fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:46:24 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1e1060-9518-4071-950e-ab95810b8993]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-402bc443-0346-4394-bca6-f218633aa2a7 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:24 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc Nov 03 07:46:24 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:24 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1a41707f-425c-4806-bc11-77e3f2bc759b tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.7b1b1c8e-a3b9-462b-b69c-3968f64e75a5" returned: 0 in 0.269s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1a41707f-425c-4806-bc11-77e3f2bc759b tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:24 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.info Nov 03 07:46:24 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:24 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-402bc443-0346-4394-bca6-f218633aa2a7 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc" returned: 0 in 0.423s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-402bc443-0346-4394-bca6-f218633aa2a7 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:24 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36 Nov 03 07:46:24 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:24 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1a41707f-425c-4806-bc11-77e3f2bc759b tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.info" returned: 0 in 0.272s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:24 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-1a41707f-425c-4806-bc11-77e3f2bc759b tempest-ProjectReaderTests-1828620363 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.info is being set with open permissions: ugo+rw Nov 03 07:46:24 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1a41707f-425c-4806-bc11-77e3f2bc759b tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:24 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.info Nov 03 07:46:24 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:25 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1a41707f-425c-4806-bc11-77e3f2bc759b tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.info" returned: 0 in 0.282s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1a41707f-425c-4806-bc11-77e3f2bc759b tempest-ProjectReaderTests-1828620363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.401s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:25 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-1a41707f-425c-4806-bc11-77e3f2bc759b tempest-ProjectReaderTests-1828620363 None] Create snapshot completed successfully Nov 03 07:46:25 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-402bc443-0346-4394-bca6-f218633aa2a7 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36" returned: 0 in 0.425s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-402bc443-0346-4394-bca6-f218633aa2a7 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:25 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36 Nov 03 07:46:25 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:25 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:25 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-402bc443-0346-4394-bca6-f218633aa2a7 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc.19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36" returned: 0 in 0.250s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:25 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-402bc443-0346-4394-bca6-f218633aa2a7 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36" released by "_delete_snapshot" :: held 1.711s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:25 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-402bc443-0346-4394-bca6-f218633aa2a7 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-8b61aa4a-ce8a-41e5-8148-6687103845fc" released by "delete_snapshot" :: held 1.736s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:25 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-402bc443-0346-4394-bca6-f218633aa2a7 tempest-ProjectMemberTests-2017513802 None] Created reservations ['608c4016-0d18-498a-8e51-bcb4f6a5b752', '49937b54-8ead-48d0-a771-842db1d03cd6', '89304ec7-c402-4bb7-ad5f-3ec85be95646', 'c6d76fcc-dae5-4f29-a63e-cef0c778b8ff'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:25 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-402bc443-0346-4394-bca6-f218633aa2a7 tempest-ProjectMemberTests-2017513802 None] Delete snapshot completed successfully. Nov 03 07:46:25 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-402bc443-0346-4394-bca6-f218633aa2a7 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-19ab86c9-a3a6-4ffc-b4aa-cbe24b793e36-delete_snapshot" released by "delete_snapshot" :: held 1.890s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:25 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b192a4a9-eafa-4170-9867-cc4821942c81 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-8b61aa4a-ce8a-41e5-8148-6687103845fc-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:25 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b192a4a9-eafa-4170-9867-cc4821942c81 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-8b61aa4a-ce8a-41e5-8148-6687103845fc-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:25 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b192a4a9-eafa-4170-9867-cc4821942c81 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-8b61aa4a-ce8a-41e5-8148-6687103845fc" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b192a4a9-eafa-4170-9867-cc4821942c81 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-8b61aa4a-ce8a-41e5-8148-6687103845fc" acquired by "delete_volume" :: waited 0.025s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4c4fcb-76d2-4b83-8b2d-4c82e6d39063]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b192a4a9-eafa-4170-9867-cc4821942c81 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Flow 'volume_create_manager' (da1eaaf0-c26f-4816-8a90-7359a605b3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9948bc7-7a2d-4765-9417-e250cff2049e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9948bc7-7a2d-4765-9417-e250cff2049e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-802008781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35dcb95-aefe-4d7e-bc99-70a354771078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39bccc70a3524fc3ada07dab93db09f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:26Z,use_quota=True,user_id='056aed73846d474a8854a6646ec2969d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ae81e0-a796-496c-9104-08db0f6b05eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ae81e0-a796-496c-9104-08db0f6b05eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b178c8e-b2e3-4ed0-bd16-1fe5df8a247b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b178c8e-b2e3-4ed0-bd16-1fe5df8a247b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b35dcb95-aefe-4d7e-bc99-70a354771078', 'volume_name': 'volume-b35dcb95-aefe-4d7e-bc99-70a354771078', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:26 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06131a79-7510-4152-a3db-14cb538b526c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:26 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06131a79-7510-4152-a3db-14cb538b526c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38542655-bcb5-416f-a499-fa65bea68419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:26 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Volume b35dcb95-aefe-4d7e-bc99-70a354771078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b35dcb95-aefe-4d7e-bc99-70a354771078', 'volume_size': 1} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-802008781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35dcb95-aefe-4d7e-bc99-70a354771078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39bccc70a3524fc3ada07dab93db09f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:26Z,use_quota=True,user_id='056aed73846d474a8854a6646ec2969d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Creating volume b35dcb95-aefe-4d7e-bc99-70a354771078 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:26 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b35dcb95-aefe-4d7e-bc99-70a354771078 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:26 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b35dcb95-aefe-4d7e-bc99-70a354771078 1073741824 Nov 03 07:46:26 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cc3bcd45-25b7-48ae-b98d-5d49a3d7400d tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-7b1b1c8e-a3b9-462b-b69c-3968f64e75a5-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cc3bcd45-25b7-48ae-b98d-5d49a3d7400d tempest-ProjectReaderTests-1828620363 None] Lock "cinder-7b1b1c8e-a3b9-462b-b69c-3968f64e75a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cc3bcd45-25b7-48ae-b98d-5d49a3d7400d tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-quobyte-4599b1c7-1a7b-431b-be50-e7b7044f5f6b" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cc3bcd45-25b7-48ae-b98d-5d49a3d7400d tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-4599b1c7-1a7b-431b-be50-e7b7044f5f6b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cc3bcd45-25b7-48ae-b98d-5d49a3d7400d tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-quobyte-7b1b1c8e-a3b9-462b-b69c-3968f64e75a5" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cc3bcd45-25b7-48ae-b98d-5d49a3d7400d tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-7b1b1c8e-a3b9-462b-b69c-3968f64e75a5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-cc3bcd45-25b7-48ae-b98d-5d49a3d7400d tempest-ProjectReaderTests-1828620363 None] Deleting offline snapshot 7b1b1c8e-a3b9-462b-b69c-3968f64e75a5 of volume 4599b1c7-1a7b-431b-be50-e7b7044f5f6b {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-cc3bcd45-25b7-48ae-b98d-5d49a3d7400d tempest-ProjectReaderTests-1828620363 None] snapshot_file for this snap is: volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.7b1b1c8e-a3b9-462b-b69c-3968f64e75a5 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f8ecc9-6609-4e45-86b6-cd030291787e]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cc3bcd45-25b7-48ae-b98d-5d49a3d7400d tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.7b1b1c8e-a3b9-462b-b69c-3968f64e75a5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:26 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.7b1b1c8e-a3b9-462b-b69c-3968f64e75a5 Nov 03 07:46:26 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:26 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b192a4a9-eafa-4170-9867-cc4821942c81 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc" returned: 0 in 0.499s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b192a4a9-eafa-4170-9867-cc4821942c81 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:26 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc Nov 03 07:46:26 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:26 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b35dcb95-aefe-4d7e-bc99-70a354771078 1073741824" returned: 0 in 0.514s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b35dcb95-aefe-4d7e-bc99-70a354771078 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:26 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b35dcb95-aefe-4d7e-bc99-70a354771078 Nov 03 07:46:26 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:26 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:26 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cc3bcd45-25b7-48ae-b98d-5d49a3d7400d tempest-ProjectReaderTests-1828620363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.7b1b1c8e-a3b9-462b-b69c-3968f64e75a5" returned: 0 in 0.425s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b192a4a9-eafa-4170-9867-cc4821942c81 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-8b61aa4a-ce8a-41e5-8148-6687103845fc" returned: 0 in 0.291s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-cc3bcd45-25b7-48ae-b98d-5d49a3d7400d tempest-ProjectReaderTests-1828620363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[306ab2a4-a5fe-4e2e-b4bd-7dff924d7a25]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cc3bcd45-25b7-48ae-b98d-5d49a3d7400d tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b192a4a9-eafa-4170-9867-cc4821942c81 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-8b61aa4a-ce8a-41e5-8148-6687103845fc" released by "delete_volume" :: held 0.916s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:26 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-b192a4a9-eafa-4170-9867-cc4821942c81 tempest-ProjectMemberTests-2017513802 None] Created reservations ['77274edd-ebce-44aa-9962-b9386162993a', '3ae33f9c-002e-46cd-8d54-5f839a8125c4', '4a31d74a-b3c1-45c8-a6b9-14f562a53f79', '7d3e3f05-cbb6-4d92-9435-1bd3a3f563c4'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:27 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b Nov 03 07:46:27 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b192a4a9-eafa-4170-9867-cc4821942c81 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b192a4a9-eafa-4170-9867-cc4821942c81 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b192a4a9-eafa-4170-9867-cc4821942c81 tempest-ProjectMemberTests-2017513802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b192a4a9-eafa-4170-9867-cc4821942c81 tempest-ProjectMemberTests-2017513802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b192a4a9-eafa-4170-9867-cc4821942c81 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b192a4a9-eafa-4170-9867-cc4821942c81 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:27 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:27 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b35dcb95-aefe-4d7e-bc99-70a354771078" returned: 0 in 0.335s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:27 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38542655-bcb5-416f-a499-fa65bea68419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b35dcb95-aefe-4d7e-bc99-70a354771078', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd20fd3-7fc2-4099-8b1c-37826b6b967f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:27 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Volume volume-b35dcb95-aefe-4d7e-bc99-70a354771078 (b35dcb95-aefe-4d7e-bc99-70a354771078): created successfully Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd20fd3-7fc2-4099-8b1c-37826b6b967f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Flow 'volume_create_manager' (da1eaaf0-c26f-4816-8a90-7359a605b3cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:27 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a17a8f55-bfcc-4d79-b0d1-397988cf2a80 tempest-ProjectReaderTests-584054805 None] Created volume successfully. Nov 03 07:46:27 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b192a4a9-eafa-4170-9867-cc4821942c81 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.337s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-b192a4a9-eafa-4170-9867-cc4821942c81 tempest-ProjectMemberTests-2017513802 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:27 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cc3bcd45-25b7-48ae-b98d-5d49a3d7400d tempest-ProjectReaderTests-1828620363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b" returned: 0 in 0.535s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cc3bcd45-25b7-48ae-b98d-5d49a3d7400d tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.7b1b1c8e-a3b9-462b-b69c-3968f64e75a5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:27 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b192a4a9-eafa-4170-9867-cc4821942c81 tempest-ProjectMemberTests-2017513802 None] Deleted volume successfully. Nov 03 07:46:27 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.7b1b1c8e-a3b9-462b-b69c-3968f64e75a5 Nov 03 07:46:27 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b192a4a9-eafa-4170-9867-cc4821942c81 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-8b61aa4a-ce8a-41e5-8148-6687103845fc-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Flow 'volume_create_manager' (0ef52cb6-a623-4f8d-a30f-9b7560565aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35cea5f8-79d8-4434-a2bc-c2adc8657df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35cea5f8-79d8-4434-a2bc-c2adc8657df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-567407331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea39cb8-b996-44b5-9c51-2ce9c456de09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed98c25bc1c64da3a0227cf8c7bef103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:28Z,use_quota=True,user_id='3b3ce7b9c2864a2db5285861bf4701c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62b0711-e30b-447b-9ea5-fb5a9d90a4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62b0711-e30b-447b-9ea5-fb5a9d90a4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f07e6b5f-dd9c-4f19-bcc0-afa6f9e09cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f07e6b5f-dd9c-4f19-bcc0-afa6f9e09cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ea39cb8-b996-44b5-9c51-2ce9c456de09', 'volume_name': 'volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:27 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686b00de-1354-4efb-8721-1363b9b947d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686b00de-1354-4efb-8721-1363b9b947d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5bb27b-dea6-4b6a-bbd8-73bf61a70cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:27 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Volume 1ea39cb8-b996-44b5-9c51-2ce9c456de09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09', 'volume_size': 1} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-567407331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea39cb8-b996-44b5-9c51-2ce9c456de09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed98c25bc1c64da3a0227cf8c7bef103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:28Z,use_quota=True,user_id='3b3ce7b9c2864a2db5285861bf4701c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Creating volume 1ea39cb8-b996-44b5-9c51-2ce9c456de09 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:27 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cc3bcd45-25b7-48ae-b98d-5d49a3d7400d tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.7b1b1c8e-a3b9-462b-b69c-3968f64e75a5" returned: 0 in 0.406s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:27 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cc3bcd45-25b7-48ae-b98d-5d49a3d7400d tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.7b1b1c8e-a3b9-462b-b69c-3968f64e75a5 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:27 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09 1073741824 Nov 03 07:46:27 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:27 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.7b1b1c8e-a3b9-462b-b69c-3968f64e75a5 Nov 03 07:46:27 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:28 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-cc3bcd45-25b7-48ae-b98d-5d49a3d7400d tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b.7b1b1c8e-a3b9-462b-b69c-3968f64e75a5" returned: 0 in 0.255s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cc3bcd45-25b7-48ae-b98d-5d49a3d7400d tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-7b1b1c8e-a3b9-462b-b69c-3968f64e75a5" released by "_delete_snapshot" :: held 1.749s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cc3bcd45-25b7-48ae-b98d-5d49a3d7400d tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-4599b1c7-1a7b-431b-be50-e7b7044f5f6b" released by "delete_snapshot" :: held 1.776s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-cc3bcd45-25b7-48ae-b98d-5d49a3d7400d tempest-ProjectReaderTests-1828620363 None] Created reservations ['63dcc94c-c317-40d2-90e4-05d8c3917e96', '4589a92d-f03a-42a7-a295-262593ae75a2', 'd4a41f72-3c16-4baa-95bb-3976e66e090c', '49363e0e-5e73-4dd0-914f-9d7ec31f6a6b'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:28 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-cc3bcd45-25b7-48ae-b98d-5d49a3d7400d tempest-ProjectReaderTests-1828620363 None] Delete snapshot completed successfully. Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-cc3bcd45-25b7-48ae-b98d-5d49a3d7400d tempest-ProjectReaderTests-1828620363 None] Lock "cinder-7b1b1c8e-a3b9-462b-b69c-3968f64e75a5-delete_snapshot" released by "delete_snapshot" :: held 1.982s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:28 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09 1073741824" returned: 0 in 0.551s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:28 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09 Nov 03 07:46:28 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-372fff17-a111-40dc-824a-385b290a2b54 tempest-ProjectReaderTests-584054805 None] Acquiring lock "cinder-b35dcb95-aefe-4d7e-bc99-70a354771078-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-372fff17-a111-40dc-824a-385b290a2b54 tempest-ProjectReaderTests-584054805 None] Lock "cinder-b35dcb95-aefe-4d7e-bc99-70a354771078-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-92eaba9f-def5-4cc6-b9e7-3e3b823467f0 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-4599b1c7-1a7b-431b-be50-e7b7044f5f6b-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-372fff17-a111-40dc-824a-385b290a2b54 tempest-ProjectReaderTests-584054805 None] Acquiring lock "cinder-quobyte-b35dcb95-aefe-4d7e-bc99-70a354771078" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-92eaba9f-def5-4cc6-b9e7-3e3b823467f0 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-4599b1c7-1a7b-431b-be50-e7b7044f5f6b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-372fff17-a111-40dc-824a-385b290a2b54 tempest-ProjectReaderTests-584054805 None] Lock "cinder-quobyte-b35dcb95-aefe-4d7e-bc99-70a354771078" acquired by "delete_volume" :: waited 0.048s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-92eaba9f-def5-4cc6-b9e7-3e3b823467f0 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-quobyte-4599b1c7-1a7b-431b-be50-e7b7044f5f6b" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80bc129-5544-47dd-897a-a8b581fd7b8e]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-372fff17-a111-40dc-824a-385b290a2b54 tempest-ProjectReaderTests-584054805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b35dcb95-aefe-4d7e-bc99-70a354771078 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-92eaba9f-def5-4cc6-b9e7-3e3b823467f0 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-4599b1c7-1a7b-431b-be50-e7b7044f5f6b" acquired by "delete_volume" :: waited 0.028s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:28 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09" returned: 0 in 0.301s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f17e06-9787-414c-90c7-d51590be2af8]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-92eaba9f-def5-4cc6-b9e7-3e3b823467f0 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5bb27b-dea6-4b6a-bbd8-73bf61a70cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1186520e-ee96-4f5b-9d42-1fb71f91c2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:28 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Volume volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09 (1ea39cb8-b996-44b5-9c51-2ce9c456de09): created successfully Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1186520e-ee96-4f5b-9d42-1fb71f91c2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:28 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b35dcb95-aefe-4d7e-bc99-70a354771078 Nov 03 07:46:28 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Flow 'volume_create_manager' (0ef52cb6-a623-4f8d-a30f-9b7560565aab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:28 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:28 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-e277a0c8-85b0-4973-93f6-257b82b11197 tempest-ProjectMemberTests-2017513802 None] Created volume successfully. Nov 03 07:46:28 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b Nov 03 07:46:28 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:29 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-372fff17-a111-40dc-824a-385b290a2b54 tempest-ProjectReaderTests-584054805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b35dcb95-aefe-4d7e-bc99-70a354771078" returned: 0 in 0.393s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-372fff17-a111-40dc-824a-385b290a2b54 tempest-ProjectReaderTests-584054805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b35dcb95-aefe-4d7e-bc99-70a354771078 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:29 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b35dcb95-aefe-4d7e-bc99-70a354771078 Nov 03 07:46:29 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:29 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-92eaba9f-def5-4cc6-b9e7-3e3b823467f0 tempest-ProjectReaderTests-1828620363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b" returned: 0 in 0.401s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-92eaba9f-def5-4cc6-b9e7-3e3b823467f0 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:29 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b Nov 03 07:46:29 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:29 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-372fff17-a111-40dc-824a-385b290a2b54 tempest-ProjectReaderTests-584054805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b35dcb95-aefe-4d7e-bc99-70a354771078" returned: 0 in 0.257s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-372fff17-a111-40dc-824a-385b290a2b54 tempest-ProjectReaderTests-584054805 None] Lock "cinder-quobyte-b35dcb95-aefe-4d7e-bc99-70a354771078" released by "delete_volume" :: held 0.724s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-372fff17-a111-40dc-824a-385b290a2b54 tempest-ProjectReaderTests-584054805 None] Created reservations ['c8553dd0-4905-4f9a-944e-8f5e8ff8e6f4', '2aa4d7c5-2a4d-45a9-b2a5-99de80af2c20', '9a971052-4bfe-4e32-800a-2c7bd0501a68', '1fc73c59-4bb6-4f08-919e-cc97bc4c1035'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:29 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-92eaba9f-def5-4cc6-b9e7-3e3b823467f0 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-4599b1c7-1a7b-431b-be50-e7b7044f5f6b" returned: 0 in 0.263s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-92eaba9f-def5-4cc6-b9e7-3e3b823467f0 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-4599b1c7-1a7b-431b-be50-e7b7044f5f6b" released by "delete_volume" :: held 0.743s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-372fff17-a111-40dc-824a-385b290a2b54 tempest-ProjectReaderTests-584054805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-372fff17-a111-40dc-824a-385b290a2b54 tempest-ProjectReaderTests-584054805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-372fff17-a111-40dc-824a-385b290a2b54 tempest-ProjectReaderTests-584054805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-372fff17-a111-40dc-824a-385b290a2b54 tempest-ProjectReaderTests-584054805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-372fff17-a111-40dc-824a-385b290a2b54 tempest-ProjectReaderTests-584054805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-372fff17-a111-40dc-824a-385b290a2b54 tempest-ProjectReaderTests-584054805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-92eaba9f-def5-4cc6-b9e7-3e3b823467f0 tempest-ProjectReaderTests-1828620363 None] Created reservations ['0d449c3f-8b99-49e9-950e-5c214fbb8af1', '7ac91456-a628-4b85-bc0c-c8ef14b902ff', '168e36cd-465a-4ef6-a25d-5a0776da6d33', '9cb93928-aba9-4da6-9891-6f3e911b2fc2'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:29 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:46:29 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-92eaba9f-def5-4cc6-b9e7-3e3b823467f0 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-92eaba9f-def5-4cc6-b9e7-3e3b823467f0 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-92eaba9f-def5-4cc6-b9e7-3e3b823467f0 tempest-ProjectReaderTests-1828620363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-92eaba9f-def5-4cc6-b9e7-3e3b823467f0 tempest-ProjectReaderTests-1828620363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-92eaba9f-def5-4cc6-b9e7-3e3b823467f0 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-92eaba9f-def5-4cc6-b9e7-3e3b823467f0 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:29 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:46:29 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:29 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-372fff17-a111-40dc-824a-385b290a2b54 tempest-ProjectReaderTests-584054805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.282s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-372fff17-a111-40dc-824a-385b290a2b54 tempest-ProjectReaderTests-584054805 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:29 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-372fff17-a111-40dc-824a-385b290a2b54 tempest-ProjectReaderTests-584054805 None] Deleted volume successfully. Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-372fff17-a111-40dc-824a-385b290a2b54 tempest-ProjectReaderTests-584054805 None] Lock "cinder-b35dcb95-aefe-4d7e-bc99-70a354771078-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:29 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-92eaba9f-def5-4cc6-b9e7-3e3b823467f0 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.305s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-92eaba9f-def5-4cc6-b9e7-3e3b823467f0 tempest-ProjectReaderTests-1828620363 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:29 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-92eaba9f-def5-4cc6-b9e7-3e3b823467f0 tempest-ProjectReaderTests-1828620363 None] Deleted volume successfully. Nov 03 07:46:29 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-92eaba9f-def5-4cc6-b9e7-3e3b823467f0 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-4599b1c7-1a7b-431b-be50-e7b7044f5f6b-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Flow 'volume_create_manager' (d3d87a88-4b87-4a55-83f7-3ed91d225b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a302ef0e-cc3d-4f7b-a20a-8cca801af0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a302ef0e-cc3d-4f7b-a20a-8cca801af0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-99911307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c05df2b-517a-4824-835e-e1b3268a6421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39bccc70a3524fc3ada07dab93db09f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:30Z,use_quota=True,user_id='056aed73846d474a8854a6646ec2969d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd793e2-15b7-4f9b-9301-9e2dc9d981b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd793e2-15b7-4f9b-9301-9e2dc9d981b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba68e228-e460-412f-871e-1fb28376d99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba68e228-e460-412f-871e-1fb28376d99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c05df2b-517a-4824-835e-e1b3268a6421', 'volume_name': 'volume-7c05df2b-517a-4824-835e-e1b3268a6421', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4021567-c6e6-4455-8acd-970396d37229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4021567-c6e6-4455-8acd-970396d37229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195c6cd6-d2ee-4c43-9357-a80fa914ca86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:30 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Volume 7c05df2b-517a-4824-835e-e1b3268a6421: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c05df2b-517a-4824-835e-e1b3268a6421', 'volume_size': 1} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-99911307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c05df2b-517a-4824-835e-e1b3268a6421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39bccc70a3524fc3ada07dab93db09f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:30Z,use_quota=True,user_id='056aed73846d474a8854a6646ec2969d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Creating volume 7c05df2b-517a-4824-835e-e1b3268a6421 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:30 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7c05df2b-517a-4824-835e-e1b3268a6421 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:30 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7c05df2b-517a-4824-835e-e1b3268a6421 1073741824 Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e6c81ed6-a351-4810-9f48-b17f5e8d7850 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:30 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Flow 'volume_create_manager' (40a2106d-2f70-4209-b74e-3a24e6eb8c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe5700f-6ee1-4602-be9c-9c5f519c0a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe5700f-6ee1-4602-be9c-9c5f519c0a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1229087426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e091d4-8895-42e7-9e33-4519ff22b72a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d016ba9019143bca2aab18a27b1a5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:31Z,use_quota=True,user_id='a802132e9b66410dbd73f46a439c9c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a23965-7cf4-4bbe-9297-bbc7c205d40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a23965-7cf4-4bbe-9297-bbc7c205d40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a7be9f4-4005-49bb-8df4-2710a25149ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a7be9f4-4005-49bb-8df4-2710a25149ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45e091d4-8895-42e7-9e33-4519ff22b72a', 'volume_name': 'volume-45e091d4-8895-42e7-9e33-4519ff22b72a', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441c8ac2-ef7a-4aa7-b518-de3ce2f8aab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441c8ac2-ef7a-4aa7-b518-de3ce2f8aab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965b9da4-74a6-4a51-8ebd-9afde999dfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:30 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Volume 45e091d4-8895-42e7-9e33-4519ff22b72a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45e091d4-8895-42e7-9e33-4519ff22b72a', 'volume_size': 1} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:30 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7c05df2b-517a-4824-835e-e1b3268a6421 1073741824" returned: 0 in 0.453s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:30 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7c05df2b-517a-4824-835e-e1b3268a6421 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:31 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7c05df2b-517a-4824-835e-e1b3268a6421 Nov 03 07:46:31 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:31 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7c05df2b-517a-4824-835e-e1b3268a6421" returned: 0 in 0.267s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:31 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:46:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e6c81ed6-a351-4810-9f48-b17f5e8d7850 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.731s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195c6cd6-d2ee-4c43-9357-a80fa914ca86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c05df2b-517a-4824-835e-e1b3268a6421', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c369b451-29f5-498a-975a-721b23de80fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:31 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-e6c81ed6-a351-4810-9f48-b17f5e8d7850 tempest-ProjectMemberTests-2017513802 None] Creating offline snapshot b2f2f52f-2b16-4aef-b752-3f0878cafb11 of volume 1ea39cb8-b996-44b5-9c51-2ce9c456de09 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:46:31 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Volume volume-7c05df2b-517a-4824-835e-e1b3268a6421 (7c05df2b-517a-4824-835e-e1b3268a6421): created successfully Nov 03 07:46:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c369b451-29f5-498a-975a-721b23de80fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:31 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Flow 'volume_create_manager' (d3d87a88-4b87-4a55-83f7-3ed91d225b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:31 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[81147afd-01d6-4373-9d23-89d200bc3982]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e6c81ed6-a351-4810-9f48-b17f5e8d7850 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:31 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b8818b84-c140-43c5-b268-468dd6dbf55c tempest-ProjectReaderTests-584054805 None] Created volume successfully. Nov 03 07:46:31 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09 Nov 03 07:46:31 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:31 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e6c81ed6-a351-4810-9f48-b17f5e8d7850 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09" returned: 0 in 0.361s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:31 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e6c81ed6-a351-4810-9f48-b17f5e8d7850 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.b2f2f52f-2b16-4aef-b752-3f0878cafb11 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:31 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.b2f2f52f-2b16-4aef-b752-3f0878cafb11 1G Nov 03 07:46:31 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:32 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e6c81ed6-a351-4810-9f48-b17f5e8d7850 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.b2f2f52f-2b16-4aef-b752-3f0878cafb11 1G" returned: 0 in 0.378s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e6c81ed6-a351-4810-9f48-b17f5e8d7850 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.b2f2f52f-2b16-4aef-b752-3f0878cafb11 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:32 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.b2f2f52f-2b16-4aef-b752-3f0878cafb11 Nov 03 07:46:32 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:32 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e6c81ed6-a351-4810-9f48-b17f5e8d7850 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.b2f2f52f-2b16-4aef-b752-3f0878cafb11" returned: 0 in 0.320s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:32 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-e6c81ed6-a351-4810-9f48-b17f5e8d7850 tempest-ProjectMemberTests-2017513802 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.b2f2f52f-2b16-4aef-b752-3f0878cafb11 is being set with open permissions: ugo+rw Nov 03 07:46:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e6c81ed6-a351-4810-9f48-b17f5e8d7850 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.b2f2f52f-2b16-4aef-b752-3f0878cafb11 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:32 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.b2f2f52f-2b16-4aef-b752-3f0878cafb11 Nov 03 07:46:32 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-524b046e-35e6-4b21-80da-d1b870841f19 tempest-ProjectReaderTests-584054805 None] Acquiring lock "cinder-7c05df2b-517a-4824-835e-e1b3268a6421-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-524b046e-35e6-4b21-80da-d1b870841f19 tempest-ProjectReaderTests-584054805 None] Lock "cinder-7c05df2b-517a-4824-835e-e1b3268a6421-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-524b046e-35e6-4b21-80da-d1b870841f19 tempest-ProjectReaderTests-584054805 None] Acquiring lock "cinder-quobyte-7c05df2b-517a-4824-835e-e1b3268a6421" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:32 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-524b046e-35e6-4b21-80da-d1b870841f19 tempest-ProjectReaderTests-584054805 None] Lock "cinder-quobyte-7c05df2b-517a-4824-835e-e1b3268a6421" acquired by "delete_volume" :: waited 0.015s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:32 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[275ecffb-cbcf-44e0-959d-6861729eb81f]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-524b046e-35e6-4b21-80da-d1b870841f19 tempest-ProjectReaderTests-584054805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7c05df2b-517a-4824-835e-e1b3268a6421 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:32 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e6c81ed6-a351-4810-9f48-b17f5e8d7850 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.b2f2f52f-2b16-4aef-b752-3f0878cafb11" returned: 0 in 0.265s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e6c81ed6-a351-4810-9f48-b17f5e8d7850 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:32 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.info Nov 03 07:46:32 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:32 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7c05df2b-517a-4824-835e-e1b3268a6421 Nov 03 07:46:32 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:32 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e6c81ed6-a351-4810-9f48-b17f5e8d7850 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.info" returned: 0 in 0.251s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:32 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-e6c81ed6-a351-4810-9f48-b17f5e8d7850 tempest-ProjectMemberTests-2017513802 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.info is being set with open permissions: ugo+rw Nov 03 07:46:32 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e6c81ed6-a351-4810-9f48-b17f5e8d7850 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:32 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.info Nov 03 07:46:32 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:33 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-524b046e-35e6-4b21-80da-d1b870841f19 tempest-ProjectReaderTests-584054805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7c05df2b-517a-4824-835e-e1b3268a6421" returned: 0 in 0.400s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-524b046e-35e6-4b21-80da-d1b870841f19 tempest-ProjectReaderTests-584054805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7c05df2b-517a-4824-835e-e1b3268a6421 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:33 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7c05df2b-517a-4824-835e-e1b3268a6421 Nov 03 07:46:33 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:33 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e6c81ed6-a351-4810-9f48-b17f5e8d7850 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.info" returned: 0 in 0.273s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-e6c81ed6-a351-4810-9f48-b17f5e8d7850 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.554s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1229087426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e091d4-8895-42e7-9e33-4519ff22b72a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d016ba9019143bca2aab18a27b1a5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:31Z,use_quota=True,user_id='a802132e9b66410dbd73f46a439c9c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Creating volume 45e091d4-8895-42e7-9e33-4519ff22b72a {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:33 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:33 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-524b046e-35e6-4b21-80da-d1b870841f19 tempest-ProjectReaderTests-584054805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-7c05df2b-517a-4824-835e-e1b3268a6421" returned: 0 in 0.279s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:33 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a 1073741824 Nov 03 07:46:33 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:33 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-e6c81ed6-a351-4810-9f48-b17f5e8d7850 tempest-ProjectMemberTests-2017513802 None] Create snapshot completed successfully Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-524b046e-35e6-4b21-80da-d1b870841f19 tempest-ProjectReaderTests-584054805 None] Lock "cinder-quobyte-7c05df2b-517a-4824-835e-e1b3268a6421" released by "delete_volume" :: held 0.726s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-524b046e-35e6-4b21-80da-d1b870841f19 tempest-ProjectReaderTests-584054805 None] Created reservations ['baa38863-7b87-446c-a60c-81ee31d8b110', 'd6514fba-ae52-4f59-b5f6-b96e160a3859', '6f473dba-8339-4630-8b28-fd0193416399', 'e27314bf-a194-472e-a383-93bb79145526'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-524b046e-35e6-4b21-80da-d1b870841f19 tempest-ProjectReaderTests-584054805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-524b046e-35e6-4b21-80da-d1b870841f19 tempest-ProjectReaderTests-584054805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-524b046e-35e6-4b21-80da-d1b870841f19 tempest-ProjectReaderTests-584054805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-524b046e-35e6-4b21-80da-d1b870841f19 tempest-ProjectReaderTests-584054805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-524b046e-35e6-4b21-80da-d1b870841f19 tempest-ProjectReaderTests-584054805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-524b046e-35e6-4b21-80da-d1b870841f19 tempest-ProjectReaderTests-584054805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-34b6776d-5bdf-4f1e-a401-2edf58ced4c5 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-b2f2f52f-2b16-4aef-b752-3f0878cafb11-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:33 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:46:33 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-34b6776d-5bdf-4f1e-a401-2edf58ced4c5 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-b2f2f52f-2b16-4aef-b752-3f0878cafb11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-34b6776d-5bdf-4f1e-a401-2edf58ced4c5 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-1ea39cb8-b996-44b5-9c51-2ce9c456de09" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-34b6776d-5bdf-4f1e-a401-2edf58ced4c5 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-1ea39cb8-b996-44b5-9c51-2ce9c456de09" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-34b6776d-5bdf-4f1e-a401-2edf58ced4c5 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-b2f2f52f-2b16-4aef-b752-3f0878cafb11" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-34b6776d-5bdf-4f1e-a401-2edf58ced4c5 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-b2f2f52f-2b16-4aef-b752-3f0878cafb11" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-34b6776d-5bdf-4f1e-a401-2edf58ced4c5 tempest-ProjectMemberTests-2017513802 None] Deleting offline snapshot b2f2f52f-2b16-4aef-b752-3f0878cafb11 of volume 1ea39cb8-b996-44b5-9c51-2ce9c456de09 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-34b6776d-5bdf-4f1e-a401-2edf58ced4c5 tempest-ProjectMemberTests-2017513802 None] snapshot_file for this snap is: volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.b2f2f52f-2b16-4aef-b752-3f0878cafb11 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[831e3c1f-f5b0-442c-b905-549ff0c5ccf1]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-34b6776d-5bdf-4f1e-a401-2edf58ced4c5 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.b2f2f52f-2b16-4aef-b752-3f0878cafb11 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:33 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-524b046e-35e6-4b21-80da-d1b870841f19 tempest-ProjectReaderTests-584054805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.301s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-524b046e-35e6-4b21-80da-d1b870841f19 tempest-ProjectReaderTests-584054805 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:33 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.b2f2f52f-2b16-4aef-b752-3f0878cafb11 Nov 03 07:46:33 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:33 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-524b046e-35e6-4b21-80da-d1b870841f19 tempest-ProjectReaderTests-584054805 None] Deleted volume successfully. Nov 03 07:46:33 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a 1073741824" returned: 0 in 0.564s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-524b046e-35e6-4b21-80da-d1b870841f19 tempest-ProjectReaderTests-584054805 None] Lock "cinder-7c05df2b-517a-4824-835e-e1b3268a6421-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:33 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:33 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a Nov 03 07:46:33 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:34 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-34b6776d-5bdf-4f1e-a401-2edf58ced4c5 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.b2f2f52f-2b16-4aef-b752-3f0878cafb11" returned: 0 in 0.427s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-34b6776d-5bdf-4f1e-a401-2edf58ced4c5 tempest-ProjectMemberTests-2017513802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:46:34 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3487a2-ab29-404a-afa3-781cd333418e]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-34b6776d-5bdf-4f1e-a401-2edf58ced4c5 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:34 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a" returned: 0 in 0.269s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:46:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965b9da4-74a6-4a51-8ebd-9afde999dfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45e091d4-8895-42e7-9e33-4519ff22b72a', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcb17e9-1ff2-4014-a4a4-585dfbf1d28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:34 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Volume volume-45e091d4-8895-42e7-9e33-4519ff22b72a (45e091d4-8895-42e7-9e33-4519ff22b72a): created successfully Nov 03 07:46:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcb17e9-1ff2-4014-a4a4-585dfbf1d28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:34 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Flow 'volume_create_manager' (40a2106d-2f70-4209-b74e-3a24e6eb8c7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:34 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-47497ebe-26fe-4a03-bb07-dd5e22cc9922 tempest-ProjectReaderTests-1828620363 None] Created volume successfully. Nov 03 07:46:34 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09 Nov 03 07:46:34 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:34 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-34b6776d-5bdf-4f1e-a401-2edf58ced4c5 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09" returned: 0 in 0.376s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-34b6776d-5bdf-4f1e-a401-2edf58ced4c5 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.b2f2f52f-2b16-4aef-b752-3f0878cafb11 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:34 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.b2f2f52f-2b16-4aef-b752-3f0878cafb11 Nov 03 07:46:34 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c519ae9c-32dc-4071-8257-b74cea589bbb tempest-ProjectReaderTests-1828620363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c519ae9c-32dc-4071-8257-b74cea589bbb tempest-ProjectReaderTests-1828620363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:34 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:34 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-c519ae9c-32dc-4071-8257-b74cea589bbb tempest-ProjectReaderTests-1828620363 None] Creating offline snapshot ec93f03c-0f64-437e-b01a-b9da52292b52 of volume 45e091d4-8895-42e7-9e33-4519ff22b72a {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:46:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-34b6776d-5bdf-4f1e-a401-2edf58ced4c5 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.b2f2f52f-2b16-4aef-b752-3f0878cafb11" returned: 0 in 0.410s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-34b6776d-5bdf-4f1e-a401-2edf58ced4c5 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.b2f2f52f-2b16-4aef-b752-3f0878cafb11 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:34 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cde5cb-d4a8-492c-a2df-26f77d4d28b2]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:34 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c519ae9c-32dc-4071-8257-b74cea589bbb tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:34 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.b2f2f52f-2b16-4aef-b752-3f0878cafb11 Nov 03 07:46:34 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:35 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a Nov 03 07:46:35 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:35 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-34b6776d-5bdf-4f1e-a401-2edf58ced4c5 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09.b2f2f52f-2b16-4aef-b752-3f0878cafb11" returned: 0 in 0.367s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-34b6776d-5bdf-4f1e-a401-2edf58ced4c5 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-b2f2f52f-2b16-4aef-b752-3f0878cafb11" released by "_delete_snapshot" :: held 1.749s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-34b6776d-5bdf-4f1e-a401-2edf58ced4c5 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-1ea39cb8-b996-44b5-9c51-2ce9c456de09" released by "delete_snapshot" :: held 1.775s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:35 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-34b6776d-5bdf-4f1e-a401-2edf58ced4c5 tempest-ProjectMemberTests-2017513802 None] Created reservations ['83ab3ece-7f3d-4b8e-ac4a-04ae3424ecfb', 'f6ba0aee-8bca-48a1-b66f-b3c3125b1adc', 'e0cd1d9b-2ac9-44bc-9ed7-5c0df298df32', 'e1a75343-8d96-47bc-bfb1-7892f60d9ec7'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:35 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c519ae9c-32dc-4071-8257-b74cea589bbb tempest-ProjectReaderTests-1828620363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a" returned: 0 in 0.550s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c519ae9c-32dc-4071-8257-b74cea589bbb tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.ec93f03c-0f64-437e-b01a-b9da52292b52 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:35 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.ec93f03c-0f64-437e-b01a-b9da52292b52 1G Nov 03 07:46:35 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:35 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-34b6776d-5bdf-4f1e-a401-2edf58ced4c5 tempest-ProjectMemberTests-2017513802 None] Delete snapshot completed successfully. Nov 03 07:46:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-34b6776d-5bdf-4f1e-a401-2edf58ced4c5 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-b2f2f52f-2b16-4aef-b752-3f0878cafb11-delete_snapshot" released by "delete_snapshot" :: held 2.015s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-43a247dd-eace-4767-bbb8-92ff19fd52f3 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-1ea39cb8-b996-44b5-9c51-2ce9c456de09-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-43a247dd-eace-4767-bbb8-92ff19fd52f3 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-1ea39cb8-b996-44b5-9c51-2ce9c456de09-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-43a247dd-eace-4767-bbb8-92ff19fd52f3 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-1ea39cb8-b996-44b5-9c51-2ce9c456de09" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:35 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-43a247dd-eace-4767-bbb8-92ff19fd52f3 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-1ea39cb8-b996-44b5-9c51-2ce9c456de09" acquired by "delete_volume" :: waited 0.022s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:35 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61a2aa0-d5e4-4076-b44b-8cd683e797ee]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:35 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-43a247dd-eace-4767-bbb8-92ff19fd52f3 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:36 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09 Nov 03 07:46:36 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:36 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c519ae9c-32dc-4071-8257-b74cea589bbb tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.ec93f03c-0f64-437e-b01a-b9da52292b52 1G" returned: 0 in 0.611s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c519ae9c-32dc-4071-8257-b74cea589bbb tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45e091d4-8895-42e7-9e33-4519ff22b72a -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.ec93f03c-0f64-437e-b01a-b9da52292b52 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:36 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45e091d4-8895-42e7-9e33-4519ff22b72a -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.ec93f03c-0f64-437e-b01a-b9da52292b52 Nov 03 07:46:36 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:36 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-43a247dd-eace-4767-bbb8-92ff19fd52f3 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09" returned: 0 in 0.433s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-43a247dd-eace-4767-bbb8-92ff19fd52f3 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:36 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09 Nov 03 07:46:36 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:36 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c519ae9c-32dc-4071-8257-b74cea589bbb tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45e091d4-8895-42e7-9e33-4519ff22b72a -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.ec93f03c-0f64-437e-b01a-b9da52292b52" returned: 0 in 0.389s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:36 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-c519ae9c-32dc-4071-8257-b74cea589bbb tempest-ProjectReaderTests-1828620363 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.ec93f03c-0f64-437e-b01a-b9da52292b52 is being set with open permissions: ugo+rw Nov 03 07:46:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c519ae9c-32dc-4071-8257-b74cea589bbb tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.ec93f03c-0f64-437e-b01a-b9da52292b52 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:36 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.ec93f03c-0f64-437e-b01a-b9da52292b52 Nov 03 07:46:36 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:36 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-43a247dd-eace-4767-bbb8-92ff19fd52f3 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-1ea39cb8-b996-44b5-9c51-2ce9c456de09" returned: 0 in 0.282s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:36 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-43a247dd-eace-4767-bbb8-92ff19fd52f3 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-1ea39cb8-b996-44b5-9c51-2ce9c456de09" released by "delete_volume" :: held 0.796s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:36 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-43a247dd-eace-4767-bbb8-92ff19fd52f3 tempest-ProjectMemberTests-2017513802 None] Created reservations ['3bde292f-d876-4cec-9a8c-97c08993b5f8', '6cf80c29-e483-4dcc-9e40-aff396571ce1', '831e6fd3-c8ee-48cb-be76-b4c9a664671f', '67a9a5a2-4a8a-4de7-ac01-6e9edbc91998'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:36 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c519ae9c-32dc-4071-8257-b74cea589bbb tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.ec93f03c-0f64-437e-b01a-b9da52292b52" returned: 0 in 0.310s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-43a247dd-eace-4767-bbb8-92ff19fd52f3 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-43a247dd-eace-4767-bbb8-92ff19fd52f3 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:36 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-43a247dd-eace-4767-bbb8-92ff19fd52f3 tempest-ProjectMemberTests-2017513802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:36 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-43a247dd-eace-4767-bbb8-92ff19fd52f3 tempest-ProjectMemberTests-2017513802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-43a247dd-eace-4767-bbb8-92ff19fd52f3 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-43a247dd-eace-4767-bbb8-92ff19fd52f3 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:36 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:46:36 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c519ae9c-32dc-4071-8257-b74cea589bbb tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:36 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:36 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.info Nov 03 07:46:36 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:37 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-43a247dd-eace-4767-bbb8-92ff19fd52f3 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.295s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-43a247dd-eace-4767-bbb8-92ff19fd52f3 tempest-ProjectMemberTests-2017513802 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:37 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-43a247dd-eace-4767-bbb8-92ff19fd52f3 tempest-ProjectMemberTests-2017513802 None] Deleted volume successfully. Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-43a247dd-eace-4767-bbb8-92ff19fd52f3 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-1ea39cb8-b996-44b5-9c51-2ce9c456de09-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:37 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c519ae9c-32dc-4071-8257-b74cea589bbb tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.info" returned: 0 in 0.363s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:37 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-c519ae9c-32dc-4071-8257-b74cea589bbb tempest-ProjectReaderTests-1828620363 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.info is being set with open permissions: ugo+rw Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c519ae9c-32dc-4071-8257-b74cea589bbb tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:37 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.info Nov 03 07:46:37 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:37 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c519ae9c-32dc-4071-8257-b74cea589bbb tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.info" returned: 0 in 0.303s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-c519ae9c-32dc-4071-8257-b74cea589bbb tempest-ProjectReaderTests-1828620363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.653s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:37 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-c519ae9c-32dc-4071-8257-b74cea589bbb tempest-ProjectReaderTests-1828620363 None] Create snapshot completed successfully Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Flow 'volume_create_manager' (a72ef525-54b1-4fe3-a33b-a1fc7dcfd741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7545638a-c70f-49c4-84fa-95f64ec07a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7545638a-c70f-49c4-84fa-95f64ec07a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1625703979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b589d2-cda1-4d57-94e3-e0565be72a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed98c25bc1c64da3a0227cf8c7bef103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:38Z,use_quota=True,user_id='3b3ce7b9c2864a2db5285861bf4701c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60798902-6194-4a85-9ee3-eec7abc328ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60798902-6194-4a85-9ee3-eec7abc328ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e2e55b-5fed-4f7e-b4f1-b88359791b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e2e55b-5fed-4f7e-b4f1-b88359791b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73b589d2-cda1-4d57-94e3-e0565be72a19', 'volume_name': 'volume-73b589d2-cda1-4d57-94e3-e0565be72a19', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21aba2e1-7ee5-42ff-a641-2ff494d2ee41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21aba2e1-7ee5-42ff-a641-2ff494d2ee41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b807724f-a289-483c-99c2-cf9f0f690b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:37 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Volume 73b589d2-cda1-4d57-94e3-e0565be72a19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73b589d2-cda1-4d57-94e3-e0565be72a19', 'volume_size': 1} Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1625703979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b589d2-cda1-4d57-94e3-e0565be72a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed98c25bc1c64da3a0227cf8c7bef103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:38Z,use_quota=True,user_id='3b3ce7b9c2864a2db5285861bf4701c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Creating volume 73b589d2-cda1-4d57-94e3-e0565be72a19 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:37 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:46:37 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:37 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19 1073741824 Nov 03 07:46:37 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-8b7bbe6e-22b8-4bc8-856f-331950b7d316 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-ec93f03c-0f64-437e-b01a-b9da52292b52-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-8b7bbe6e-22b8-4bc8-856f-331950b7d316 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-ec93f03c-0f64-437e-b01a-b9da52292b52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-8b7bbe6e-22b8-4bc8-856f-331950b7d316 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-quobyte-45e091d4-8895-42e7-9e33-4519ff22b72a" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-8b7bbe6e-22b8-4bc8-856f-331950b7d316 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-45e091d4-8895-42e7-9e33-4519ff22b72a" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-8b7bbe6e-22b8-4bc8-856f-331950b7d316 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-quobyte-ec93f03c-0f64-437e-b01a-b9da52292b52" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:38 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-8b7bbe6e-22b8-4bc8-856f-331950b7d316 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-ec93f03c-0f64-437e-b01a-b9da52292b52" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:38 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-8b7bbe6e-22b8-4bc8-856f-331950b7d316 tempest-ProjectReaderTests-1828620363 None] Deleting offline snapshot ec93f03c-0f64-437e-b01a-b9da52292b52 of volume 45e091d4-8895-42e7-9e33-4519ff22b72a {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:46:38 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-8b7bbe6e-22b8-4bc8-856f-331950b7d316 tempest-ProjectReaderTests-1828620363 None] snapshot_file for this snap is: volume-45e091d4-8895-42e7-9e33-4519ff22b72a.ec93f03c-0f64-437e-b01a-b9da52292b52 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:46:38 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c295e0-fc4a-4fe3-ad12-5d9506ae3dc6]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8b7bbe6e-22b8-4bc8-856f-331950b7d316 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.ec93f03c-0f64-437e-b01a-b9da52292b52 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:38 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19 1073741824" returned: 0 in 0.615s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:38 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19 Nov 03 07:46:38 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:38 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.ec93f03c-0f64-437e-b01a-b9da52292b52 Nov 03 07:46:38 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:38 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19" returned: 0 in 0.310s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:38 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:46:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:38 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b807724f-a289-483c-99c2-cf9f0f690b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73b589d2-cda1-4d57-94e3-e0565be72a19', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:38 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0e46c3-b95f-4363-a29f-df8dd05ebbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:38 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8b7bbe6e-22b8-4bc8-856f-331950b7d316 tempest-ProjectReaderTests-1828620363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.ec93f03c-0f64-437e-b01a-b9da52292b52" returned: 0 in 0.449s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:38 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-8b7bbe6e-22b8-4bc8-856f-331950b7d316 tempest-ProjectReaderTests-1828620363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45e091d4-8895-42e7-9e33-4519ff22b72a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:46:38 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Volume volume-73b589d2-cda1-4d57-94e3-e0565be72a19 (73b589d2-cda1-4d57-94e3-e0565be72a19): created successfully Nov 03 07:46:38 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0e46c3-b95f-4363-a29f-df8dd05ebbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:38 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Flow 'volume_create_manager' (a72ef525-54b1-4fe3-a33b-a1fc7dcfd741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:38 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[406d3a1d-2da1-45ab-9c84-89ae727e7939]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:38 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8b7bbe6e-22b8-4bc8-856f-331950b7d316 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:38 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-ba104e00-4e15-49f6-96b6-c2592bea3aaa tempest-ProjectMemberTests-2017513802 None] Created volume successfully. Nov 03 07:46:38 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a Nov 03 07:46:38 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:39 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8b7bbe6e-22b8-4bc8-856f-331950b7d316 tempest-ProjectReaderTests-1828620363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a" returned: 0 in 0.436s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8b7bbe6e-22b8-4bc8-856f-331950b7d316 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.ec93f03c-0f64-437e-b01a-b9da52292b52 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:39 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.ec93f03c-0f64-437e-b01a-b9da52292b52 Nov 03 07:46:39 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:39 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8b7bbe6e-22b8-4bc8-856f-331950b7d316 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.ec93f03c-0f64-437e-b01a-b9da52292b52" returned: 0 in 0.403s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8b7bbe6e-22b8-4bc8-856f-331950b7d316 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.ec93f03c-0f64-437e-b01a-b9da52292b52 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:39 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.ec93f03c-0f64-437e-b01a-b9da52292b52 Nov 03 07:46:39 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-685a710d-df2d-4463-92b4-65479121e07f tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-685a710d-df2d-4463-92b4-65479121e07f tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:39 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-685a710d-df2d-4463-92b4-65479121e07f tempest-ProjectMemberTests-2017513802 None] Creating offline snapshot 2e054556-f842-4f9a-a4fb-48f67e2a733f of volume 73b589d2-cda1-4d57-94e3-e0565be72a19 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:46:39 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cd92a6-869a-449a-88dc-d5d73cf9e94d]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-685a710d-df2d-4463-92b4-65479121e07f tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:39 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:39 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8b7bbe6e-22b8-4bc8-856f-331950b7d316 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a.ec93f03c-0f64-437e-b01a-b9da52292b52" returned: 0 in 0.322s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:39 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-8b7bbe6e-22b8-4bc8-856f-331950b7d316 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-ec93f03c-0f64-437e-b01a-b9da52292b52" released by "_delete_snapshot" :: held 1.761s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:39 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-8b7bbe6e-22b8-4bc8-856f-331950b7d316 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-45e091d4-8895-42e7-9e33-4519ff22b72a" released by "delete_snapshot" :: held 1.800s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:40 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19 Nov 03 07:46:40 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:40 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-8b7bbe6e-22b8-4bc8-856f-331950b7d316 tempest-ProjectReaderTests-1828620363 None] Created reservations ['17aa1ea6-81a3-4033-a265-2c7eb5ab21dc', 'fdc2943c-e978-4639-a9b3-11ae803f3cdb', '508ae7c9-fa72-40fa-9c47-20d3b47ead25', '6373152f-cf63-40b9-a63c-4a12e2b9ef82'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:40 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-8b7bbe6e-22b8-4bc8-856f-331950b7d316 tempest-ProjectReaderTests-1828620363 None] Delete snapshot completed successfully. Nov 03 07:46:40 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-8b7bbe6e-22b8-4bc8-856f-331950b7d316 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-ec93f03c-0f64-437e-b01a-b9da52292b52-delete_snapshot" released by "delete_snapshot" :: held 2.035s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:40 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0614a75c-9273-4729-a1a8-f8d8147f9545 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-45e091d4-8895-42e7-9e33-4519ff22b72a-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:40 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0614a75c-9273-4729-a1a8-f8d8147f9545 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-45e091d4-8895-42e7-9e33-4519ff22b72a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:40 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-685a710d-df2d-4463-92b4-65479121e07f tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19" returned: 0 in 0.495s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-685a710d-df2d-4463-92b4-65479121e07f tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.2e054556-f842-4f9a-a4fb-48f67e2a733f 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:40 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.2e054556-f842-4f9a-a4fb-48f67e2a733f 1G Nov 03 07:46:40 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:40 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0614a75c-9273-4729-a1a8-f8d8147f9545 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-quobyte-45e091d4-8895-42e7-9e33-4519ff22b72a" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:40 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0614a75c-9273-4729-a1a8-f8d8147f9545 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-45e091d4-8895-42e7-9e33-4519ff22b72a" acquired by "delete_volume" :: waited 0.027s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:40 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[e108c92b-a2af-4972-bacb-4b977f99530a]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0614a75c-9273-4729-a1a8-f8d8147f9545 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:40 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a Nov 03 07:46:40 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:40 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-685a710d-df2d-4463-92b4-65479121e07f tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.2e054556-f842-4f9a-a4fb-48f67e2a733f 1G" returned: 0 in 0.523s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-685a710d-df2d-4463-92b4-65479121e07f tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73b589d2-cda1-4d57-94e3-e0565be72a19 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.2e054556-f842-4f9a-a4fb-48f67e2a733f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:40 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73b589d2-cda1-4d57-94e3-e0565be72a19 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.2e054556-f842-4f9a-a4fb-48f67e2a733f Nov 03 07:46:40 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:40 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0614a75c-9273-4729-a1a8-f8d8147f9545 tempest-ProjectReaderTests-1828620363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a" returned: 0 in 0.436s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:40 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0614a75c-9273-4729-a1a8-f8d8147f9545 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:41 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a Nov 03 07:46:41 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:41 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0614a75c-9273-4729-a1a8-f8d8147f9545 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-45e091d4-8895-42e7-9e33-4519ff22b72a" returned: 0 in 0.292s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:41 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-685a710d-df2d-4463-92b4-65479121e07f tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73b589d2-cda1-4d57-94e3-e0565be72a19 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.2e054556-f842-4f9a-a4fb-48f67e2a733f" returned: 0 in 0.364s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:41 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-685a710d-df2d-4463-92b4-65479121e07f tempest-ProjectMemberTests-2017513802 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.2e054556-f842-4f9a-a4fb-48f67e2a733f is being set with open permissions: ugo+rw Nov 03 07:46:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-685a710d-df2d-4463-92b4-65479121e07f tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.2e054556-f842-4f9a-a4fb-48f67e2a733f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:41 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0614a75c-9273-4729-a1a8-f8d8147f9545 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-45e091d4-8895-42e7-9e33-4519ff22b72a" released by "delete_volume" :: held 0.823s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:41 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.2e054556-f842-4f9a-a4fb-48f67e2a733f Nov 03 07:46:41 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:41 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-0614a75c-9273-4729-a1a8-f8d8147f9545 tempest-ProjectReaderTests-1828620363 None] Created reservations ['d576799a-f285-43fa-9e83-2b9c7c71bf9c', '73aaddf4-e93e-4313-997f-e124ac1cc7d0', '46dbb9b0-c7ca-4f7b-a31a-0fa50f76ae06', '0d55bd4a-26f9-4efe-ad3e-1e0a38129978'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0614a75c-9273-4729-a1a8-f8d8147f9545 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0614a75c-9273-4729-a1a8-f8d8147f9545 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:41 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0614a75c-9273-4729-a1a8-f8d8147f9545 tempest-ProjectReaderTests-1828620363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:41 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-0614a75c-9273-4729-a1a8-f8d8147f9545 tempest-ProjectReaderTests-1828620363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-0614a75c-9273-4729-a1a8-f8d8147f9545 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0614a75c-9273-4729-a1a8-f8d8147f9545 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:41 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:46:41 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:41 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-685a710d-df2d-4463-92b4-65479121e07f tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.2e054556-f842-4f9a-a4fb-48f67e2a733f" returned: 0 in 0.280s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-685a710d-df2d-4463-92b4-65479121e07f tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:41 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.info Nov 03 07:46:41 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:41 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-0614a75c-9273-4729-a1a8-f8d8147f9545 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.304s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:41 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-0614a75c-9273-4729-a1a8-f8d8147f9545 tempest-ProjectReaderTests-1828620363 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:41 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-0614a75c-9273-4729-a1a8-f8d8147f9545 tempest-ProjectReaderTests-1828620363 None] Deleted volume successfully. Nov 03 07:46:41 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-0614a75c-9273-4729-a1a8-f8d8147f9545 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-45e091d4-8895-42e7-9e33-4519ff22b72a-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:41 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-685a710d-df2d-4463-92b4-65479121e07f tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.info" returned: 0 in 0.290s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:41 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-685a710d-df2d-4463-92b4-65479121e07f tempest-ProjectMemberTests-2017513802 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.info is being set with open permissions: ugo+rw Nov 03 07:46:41 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-685a710d-df2d-4463-92b4-65479121e07f tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:41 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.info Nov 03 07:46:41 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Flow 'volume_create_manager' (ab79b0b3-04e0-4138-85a3-91ceeede906e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6001a3a9-5683-42ea-8625-a4c70e10c9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6001a3a9-5683-42ea-8625-a4c70e10c9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1100642966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7647b49-c3b6-4353-be1f-2cca240d9642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d016ba9019143bca2aab18a27b1a5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:42Z,use_quota=True,user_id='a802132e9b66410dbd73f46a439c9c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95bdc969-fa97-4d85-823e-7cb1fe1bd687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95bdc969-fa97-4d85-823e-7cb1fe1bd687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57564829-b461-4872-b1e5-0cf02440c58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57564829-b461-4872-b1e5-0cf02440c58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7647b49-c3b6-4353-be1f-2cca240d9642', 'volume_name': 'volume-e7647b49-c3b6-4353-be1f-2cca240d9642', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541cc40b-5e3e-45ff-8ba6-37712ac51487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541cc40b-5e3e-45ff-8ba6-37712ac51487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d7376d-92d0-4fb3-961d-fe5459cb78d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:42 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Volume e7647b49-c3b6-4353-be1f-2cca240d9642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7647b49-c3b6-4353-be1f-2cca240d9642', 'volume_size': 1} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:42 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-685a710d-df2d-4463-92b4-65479121e07f tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.info" returned: 0 in 0.289s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-685a710d-df2d-4463-92b4-65479121e07f tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.346s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.048s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1100642966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7647b49-c3b6-4353-be1f-2cca240d9642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d016ba9019143bca2aab18a27b1a5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:42Z,use_quota=True,user_id='a802132e9b66410dbd73f46a439c9c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Creating volume e7647b49-c3b6-4353-be1f-2cca240d9642 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:42 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:42 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642 1073741824 Nov 03 07:46:42 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:42 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-685a710d-df2d-4463-92b4-65479121e07f tempest-ProjectMemberTests-2017513802 None] Create snapshot completed successfully Nov 03 07:46:42 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642 1073741824" returned: 0 in 0.431s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:42 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642 Nov 03 07:46:42 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:42 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642" returned: 0 in 0.248s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d7376d-92d0-4fb3-961d-fe5459cb78d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7647b49-c3b6-4353-be1f-2cca240d9642', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d8cdcb-97c9-4332-8ed4-451bd6ab595d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:42 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Volume volume-e7647b49-c3b6-4353-be1f-2cca240d9642 (e7647b49-c3b6-4353-be1f-2cca240d9642): created successfully Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d8cdcb-97c9-4332-8ed4-451bd6ab595d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:42 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Flow 'volume_create_manager' (ab79b0b3-04e0-4138-85a3-91ceeede906e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:43 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-40f06ddd-9222-4d01-8030-6e8f86514415 tempest-ProjectReaderTests-1828620363 None] Created volume successfully. Nov 03 07:46:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6416c4e8-7eae-4bf6-a080-15a7c45bf8be tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-2e054556-f842-4f9a-a4fb-48f67e2a733f-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6416c4e8-7eae-4bf6-a080-15a7c45bf8be tempest-ProjectMemberTests-2017513802 None] Lock "cinder-2e054556-f842-4f9a-a4fb-48f67e2a733f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6416c4e8-7eae-4bf6-a080-15a7c45bf8be tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-73b589d2-cda1-4d57-94e3-e0565be72a19" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6416c4e8-7eae-4bf6-a080-15a7c45bf8be tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-73b589d2-cda1-4d57-94e3-e0565be72a19" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6416c4e8-7eae-4bf6-a080-15a7c45bf8be tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-2e054556-f842-4f9a-a4fb-48f67e2a733f" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:43 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6416c4e8-7eae-4bf6-a080-15a7c45bf8be tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-2e054556-f842-4f9a-a4fb-48f67e2a733f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:43 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-6416c4e8-7eae-4bf6-a080-15a7c45bf8be tempest-ProjectMemberTests-2017513802 None] Deleting offline snapshot 2e054556-f842-4f9a-a4fb-48f67e2a733f of volume 73b589d2-cda1-4d57-94e3-e0565be72a19 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:46:43 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-6416c4e8-7eae-4bf6-a080-15a7c45bf8be tempest-ProjectMemberTests-2017513802 None] snapshot_file for this snap is: volume-73b589d2-cda1-4d57-94e3-e0565be72a19.2e054556-f842-4f9a-a4fb-48f67e2a733f {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:46:43 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5508718-9938-42d2-b467-fdd949483018]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6416c4e8-7eae-4bf6-a080-15a7c45bf8be tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.2e054556-f842-4f9a-a4fb-48f67e2a733f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:43 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.2e054556-f842-4f9a-a4fb-48f67e2a733f Nov 03 07:46:43 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d8fc0e0f-3c88-4bd7-8e60-cc00ff98adc7 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d8fc0e0f-3c88-4bd7-8e60-cc00ff98adc7 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:43 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-d8fc0e0f-3c88-4bd7-8e60-cc00ff98adc7 tempest-ProjectReaderTests-1828620363 None] Creating offline snapshot 626c10ef-f330-42b5-adb4-dbf44145dd92 of volume e7647b49-c3b6-4353-be1f-2cca240d9642 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:46:43 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccee072f-7ef7-4dea-a79a-ef0e83b11fe0]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d8fc0e0f-3c88-4bd7-8e60-cc00ff98adc7 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:43 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642 Nov 03 07:46:43 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:43 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6416c4e8-7eae-4bf6-a080-15a7c45bf8be tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.2e054556-f842-4f9a-a4fb-48f67e2a733f" returned: 0 in 0.412s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:43 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-6416c4e8-7eae-4bf6-a080-15a7c45bf8be tempest-ProjectMemberTests-2017513802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73b589d2-cda1-4d57-94e3-e0565be72a19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:46:43 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[795146c9-d328-43d5-82e9-7ae296c7fbb8]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6416c4e8-7eae-4bf6-a080-15a7c45bf8be tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:43 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19 Nov 03 07:46:43 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:43 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d8fc0e0f-3c88-4bd7-8e60-cc00ff98adc7 tempest-ProjectReaderTests-1828620363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642" returned: 0 in 0.380s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d8fc0e0f-3c88-4bd7-8e60-cc00ff98adc7 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.626c10ef-f330-42b5-adb4-dbf44145dd92 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:43 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.626c10ef-f330-42b5-adb4-dbf44145dd92 1G Nov 03 07:46:43 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:43 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6416c4e8-7eae-4bf6-a080-15a7c45bf8be tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19" returned: 0 in 0.386s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:43 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6416c4e8-7eae-4bf6-a080-15a7c45bf8be tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.2e054556-f842-4f9a-a4fb-48f67e2a733f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:43 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.2e054556-f842-4f9a-a4fb-48f67e2a733f Nov 03 07:46:43 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:44 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d8fc0e0f-3c88-4bd7-8e60-cc00ff98adc7 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.626c10ef-f330-42b5-adb4-dbf44145dd92 1G" returned: 0 in 0.462s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d8fc0e0f-3c88-4bd7-8e60-cc00ff98adc7 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7647b49-c3b6-4353-be1f-2cca240d9642 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.626c10ef-f330-42b5-adb4-dbf44145dd92 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:44 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7647b49-c3b6-4353-be1f-2cca240d9642 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.626c10ef-f330-42b5-adb4-dbf44145dd92 Nov 03 07:46:44 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:44 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6416c4e8-7eae-4bf6-a080-15a7c45bf8be tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.2e054556-f842-4f9a-a4fb-48f67e2a733f" returned: 0 in 0.408s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6416c4e8-7eae-4bf6-a080-15a7c45bf8be tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.2e054556-f842-4f9a-a4fb-48f67e2a733f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:44 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.2e054556-f842-4f9a-a4fb-48f67e2a733f Nov 03 07:46:44 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:44 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d8fc0e0f-3c88-4bd7-8e60-cc00ff98adc7 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7647b49-c3b6-4353-be1f-2cca240d9642 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.626c10ef-f330-42b5-adb4-dbf44145dd92" returned: 0 in 0.312s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:44 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-d8fc0e0f-3c88-4bd7-8e60-cc00ff98adc7 tempest-ProjectReaderTests-1828620363 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.626c10ef-f330-42b5-adb4-dbf44145dd92 is being set with open permissions: ugo+rw Nov 03 07:46:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d8fc0e0f-3c88-4bd7-8e60-cc00ff98adc7 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.626c10ef-f330-42b5-adb4-dbf44145dd92 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:44 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.626c10ef-f330-42b5-adb4-dbf44145dd92 Nov 03 07:46:44 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:44 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-6416c4e8-7eae-4bf6-a080-15a7c45bf8be tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19.2e054556-f842-4f9a-a4fb-48f67e2a733f" returned: 0 in 0.271s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6416c4e8-7eae-4bf6-a080-15a7c45bf8be tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-2e054556-f842-4f9a-a4fb-48f67e2a733f" released by "_delete_snapshot" :: held 1.598s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6416c4e8-7eae-4bf6-a080-15a7c45bf8be tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-73b589d2-cda1-4d57-94e3-e0565be72a19" released by "delete_snapshot" :: held 1.623s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:44 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-6416c4e8-7eae-4bf6-a080-15a7c45bf8be tempest-ProjectMemberTests-2017513802 None] Created reservations ['9174ef4a-4a3b-4183-bd32-1448b08523a1', 'b3070ed8-0f09-49bf-b803-3bf7fccd81a9', '548b7fed-0d10-4b5a-abb9-d8085ae87610', '9884bce5-599b-42f7-975d-5d316d3ec2f3'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:44 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d8fc0e0f-3c88-4bd7-8e60-cc00ff98adc7 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.626c10ef-f330-42b5-adb4-dbf44145dd92" returned: 0 in 0.260s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:44 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d8fc0e0f-3c88-4bd7-8e60-cc00ff98adc7 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:44 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.info Nov 03 07:46:44 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:44 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-6416c4e8-7eae-4bf6-a080-15a7c45bf8be tempest-ProjectMemberTests-2017513802 None] Delete snapshot completed successfully. Nov 03 07:46:44 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-6416c4e8-7eae-4bf6-a080-15a7c45bf8be tempest-ProjectMemberTests-2017513802 None] Lock "cinder-2e054556-f842-4f9a-a4fb-48f67e2a733f-delete_snapshot" released by "delete_snapshot" :: held 1.803s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:45 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d8fc0e0f-3c88-4bd7-8e60-cc00ff98adc7 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.info" returned: 0 in 0.262s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:45 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-d8fc0e0f-3c88-4bd7-8e60-cc00ff98adc7 tempest-ProjectReaderTests-1828620363 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.info is being set with open permissions: ugo+rw Nov 03 07:46:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d8fc0e0f-3c88-4bd7-8e60-cc00ff98adc7 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:45 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.info Nov 03 07:46:45 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a021a7dc-ed01-4f63-ba79-5251e8f0c712 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-73b589d2-cda1-4d57-94e3-e0565be72a19-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a021a7dc-ed01-4f63-ba79-5251e8f0c712 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-73b589d2-cda1-4d57-94e3-e0565be72a19-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a021a7dc-ed01-4f63-ba79-5251e8f0c712 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-73b589d2-cda1-4d57-94e3-e0565be72a19" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a021a7dc-ed01-4f63-ba79-5251e8f0c712 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-73b589d2-cda1-4d57-94e3-e0565be72a19" acquired by "delete_volume" :: waited 0.014s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:45 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d8fc0e0f-3c88-4bd7-8e60-cc00ff98adc7 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.info" returned: 0 in 0.281s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d8fc0e0f-3c88-4bd7-8e60-cc00ff98adc7 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.047s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:45 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8a8cd3-773e-4ac2-af8a-0b9507d29b66]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a021a7dc-ed01-4f63-ba79-5251e8f0c712 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:45 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-d8fc0e0f-3c88-4bd7-8e60-cc00ff98adc7 tempest-ProjectReaderTests-1828620363 None] Create snapshot completed successfully Nov 03 07:46:45 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19 Nov 03 07:46:45 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:45 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a021a7dc-ed01-4f63-ba79-5251e8f0c712 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19" returned: 0 in 0.369s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a021a7dc-ed01-4f63-ba79-5251e8f0c712 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:45 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19 Nov 03 07:46:45 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:45 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:45 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a021a7dc-ed01-4f63-ba79-5251e8f0c712 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-73b589d2-cda1-4d57-94e3-e0565be72a19" returned: 0 in 0.235s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:45 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a021a7dc-ed01-4f63-ba79-5251e8f0c712 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-73b589d2-cda1-4d57-94e3-e0565be72a19" released by "delete_volume" :: held 0.692s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-a021a7dc-ed01-4f63-ba79-5251e8f0c712 tempest-ProjectMemberTests-2017513802 None] Created reservations ['abb2adc3-a6d8-43d3-8341-5a3de35a2159', 'faa28aa3-a6e8-496d-9ace-c0a6ed7755fc', 'cd2457b4-a0b1-49b4-bdd8-c38ec7235f83', 'f4175f4a-7917-415b-9389-aac5fc5378b5'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a021a7dc-ed01-4f63-ba79-5251e8f0c712 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a021a7dc-ed01-4f63-ba79-5251e8f0c712 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a021a7dc-ed01-4f63-ba79-5251e8f0c712 tempest-ProjectMemberTests-2017513802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a021a7dc-ed01-4f63-ba79-5251e8f0c712 tempest-ProjectMemberTests-2017513802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a021a7dc-ed01-4f63-ba79-5251e8f0c712 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a021a7dc-ed01-4f63-ba79-5251e8f0c712 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:46 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:46:46 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bc2bef30-f5a9-4565-b7d8-c84f0cf24aa2 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-626c10ef-f330-42b5-adb4-dbf44145dd92-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:46 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a021a7dc-ed01-4f63-ba79-5251e8f0c712 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.275s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a021a7dc-ed01-4f63-ba79-5251e8f0c712 tempest-ProjectMemberTests-2017513802 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:46 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a021a7dc-ed01-4f63-ba79-5251e8f0c712 tempest-ProjectMemberTests-2017513802 None] Deleted volume successfully. Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bc2bef30-f5a9-4565-b7d8-c84f0cf24aa2 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-626c10ef-f330-42b5-adb4-dbf44145dd92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bc2bef30-f5a9-4565-b7d8-c84f0cf24aa2 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-quobyte-e7647b49-c3b6-4353-be1f-2cca240d9642" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bc2bef30-f5a9-4565-b7d8-c84f0cf24aa2 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-e7647b49-c3b6-4353-be1f-2cca240d9642" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bc2bef30-f5a9-4565-b7d8-c84f0cf24aa2 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-quobyte-626c10ef-f330-42b5-adb4-dbf44145dd92" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-a021a7dc-ed01-4f63-ba79-5251e8f0c712 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-73b589d2-cda1-4d57-94e3-e0565be72a19-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bc2bef30-f5a9-4565-b7d8-c84f0cf24aa2 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-626c10ef-f330-42b5-adb4-dbf44145dd92" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-bc2bef30-f5a9-4565-b7d8-c84f0cf24aa2 tempest-ProjectReaderTests-1828620363 None] Deleting offline snapshot 626c10ef-f330-42b5-adb4-dbf44145dd92 of volume e7647b49-c3b6-4353-be1f-2cca240d9642 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-bc2bef30-f5a9-4565-b7d8-c84f0cf24aa2 tempest-ProjectReaderTests-1828620363 None] snapshot_file for this snap is: volume-e7647b49-c3b6-4353-be1f-2cca240d9642.626c10ef-f330-42b5-adb4-dbf44145dd92 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[56466606-354d-444e-8c86-a950f9b341f4]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bc2bef30-f5a9-4565-b7d8-c84f0cf24aa2 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.626c10ef-f330-42b5-adb4-dbf44145dd92 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:46 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.626c10ef-f330-42b5-adb4-dbf44145dd92 Nov 03 07:46:46 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Flow 'volume_create_manager' (33736745-d8fe-4364-8bcd-f9d42ccf7bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd1092e-cdf3-4702-bcba-81b8a084762b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd1092e-cdf3-4702-bcba-81b8a084762b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2054882986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590d1ee4-507b-4b71-b66c-25351c4b296f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed98c25bc1c64da3a0227cf8c7bef103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:47Z,use_quota=True,user_id='3b3ce7b9c2864a2db5285861bf4701c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd04b35a-97f0-4fa6-ac67-80ccdacacb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd04b35a-97f0-4fa6-ac67-80ccdacacb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c96112-6566-4f2a-9567-7f441d77601c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c96112-6566-4f2a-9567-7f441d77601c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '590d1ee4-507b-4b71-b66c-25351c4b296f', 'volume_name': 'volume-590d1ee4-507b-4b71-b66c-25351c4b296f', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caab68ff-92f0-4c72-bc78-3900964938b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caab68ff-92f0-4c72-bc78-3900964938b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e3a6ce-048f-401e-a221-6bf1e42362a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:46 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Volume 590d1ee4-507b-4b71-b66c-25351c4b296f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-590d1ee4-507b-4b71-b66c-25351c4b296f', 'volume_size': 1} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2054882986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590d1ee4-507b-4b71-b66c-25351c4b296f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed98c25bc1c64da3a0227cf8c7bef103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:47Z,use_quota=True,user_id='3b3ce7b9c2864a2db5285861bf4701c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Creating volume 590d1ee4-507b-4b71-b66c-25351c4b296f {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:46 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:46:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:47 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f 1073741824 Nov 03 07:46:47 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:47 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bc2bef30-f5a9-4565-b7d8-c84f0cf24aa2 tempest-ProjectReaderTests-1828620363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.626c10ef-f330-42b5-adb4-dbf44145dd92" returned: 0 in 0.382s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-bc2bef30-f5a9-4565-b7d8-c84f0cf24aa2 tempest-ProjectReaderTests-1828620363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7647b49-c3b6-4353-be1f-2cca240d9642(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:46:47 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[afec671d-a9a3-45c8-bfd5-c6ef085a0708]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bc2bef30-f5a9-4565-b7d8-c84f0cf24aa2 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:47 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642 Nov 03 07:46:47 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:47 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f 1073741824" returned: 0 in 0.477s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:47 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bc2bef30-f5a9-4565-b7d8-c84f0cf24aa2 tempest-ProjectReaderTests-1828620363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642" returned: 0 in 0.411s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bc2bef30-f5a9-4565-b7d8-c84f0cf24aa2 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.626c10ef-f330-42b5-adb4-dbf44145dd92 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:47 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.626c10ef-f330-42b5-adb4-dbf44145dd92 Nov 03 07:46:47 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:47 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f Nov 03 07:46:47 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:47 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f" returned: 0 in 0.265s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:46:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e3a6ce-048f-401e-a221-6bf1e42362a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-590d1ee4-507b-4b71-b66c-25351c4b296f', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7eb835d-52d3-48d1-af6e-dd0f1fae790c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:47 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Volume volume-590d1ee4-507b-4b71-b66c-25351c4b296f (590d1ee4-507b-4b71-b66c-25351c4b296f): created successfully Nov 03 07:46:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7eb835d-52d3-48d1-af6e-dd0f1fae790c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Flow 'volume_create_manager' (33736745-d8fe-4364-8bcd-f9d42ccf7bcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:47 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b63ed14e-6f66-481c-ac74-2f8a6e5cea10 tempest-ProjectMemberTests-2017513802 None] Created volume successfully. Nov 03 07:46:47 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bc2bef30-f5a9-4565-b7d8-c84f0cf24aa2 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.626c10ef-f330-42b5-adb4-dbf44145dd92" returned: 0 in 0.385s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bc2bef30-f5a9-4565-b7d8-c84f0cf24aa2 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.626c10ef-f330-42b5-adb4-dbf44145dd92 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:47 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.626c10ef-f330-42b5-adb4-dbf44145dd92 Nov 03 07:46:47 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:48 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-bc2bef30-f5a9-4565-b7d8-c84f0cf24aa2 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642.626c10ef-f330-42b5-adb4-dbf44145dd92" returned: 0 in 0.257s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bc2bef30-f5a9-4565-b7d8-c84f0cf24aa2 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-626c10ef-f330-42b5-adb4-dbf44145dd92" released by "_delete_snapshot" :: held 1.548s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bc2bef30-f5a9-4565-b7d8-c84f0cf24aa2 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-e7647b49-c3b6-4353-be1f-2cca240d9642" released by "delete_snapshot" :: held 1.573s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:48 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-bc2bef30-f5a9-4565-b7d8-c84f0cf24aa2 tempest-ProjectReaderTests-1828620363 None] Created reservations ['8d774057-1b35-453e-9f69-b2cadbf2b6e0', 'c7beace4-33ff-41e9-9898-d15b82103dab', '9cacaf97-78b0-4aa6-9fc3-1e33762eb1a4', 'de83ed32-46a0-4e56-ab7c-612a1a9483e2'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:48 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-bc2bef30-f5a9-4565-b7d8-c84f0cf24aa2 tempest-ProjectReaderTests-1828620363 None] Delete snapshot completed successfully. Nov 03 07:46:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-bc2bef30-f5a9-4565-b7d8-c84f0cf24aa2 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-626c10ef-f330-42b5-adb4-dbf44145dd92-delete_snapshot" released by "delete_snapshot" :: held 1.716s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-77e5d7ce-a32c-4780-a6bf-338d029511c9 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-e7647b49-c3b6-4353-be1f-2cca240d9642-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-77e5d7ce-a32c-4780-a6bf-338d029511c9 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-e7647b49-c3b6-4353-be1f-2cca240d9642-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-77e5d7ce-a32c-4780-a6bf-338d029511c9 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-quobyte-e7647b49-c3b6-4353-be1f-2cca240d9642" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:48 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-77e5d7ce-a32c-4780-a6bf-338d029511c9 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-e7647b49-c3b6-4353-be1f-2cca240d9642" acquired by "delete_volume" :: waited 0.014s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:48 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[799c45f3-dc6a-4083-bf5b-f6f1518fa54b]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-77e5d7ce-a32c-4780-a6bf-338d029511c9 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:48 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642 Nov 03 07:46:48 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a0f06142-cb19-41ab-946c-e6874a7c2e24 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a0f06142-cb19-41ab-946c-e6874a7c2e24 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:49 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-77e5d7ce-a32c-4780-a6bf-338d029511c9 tempest-ProjectReaderTests-1828620363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642" returned: 0 in 0.396s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-77e5d7ce-a32c-4780-a6bf-338d029511c9 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:49 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:46:49 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-a0f06142-cb19-41ab-946c-e6874a7c2e24 tempest-ProjectMemberTests-2017513802 None] Creating offline snapshot 9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2 of volume 590d1ee4-507b-4b71-b66c-25351c4b296f {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:46:49 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642 Nov 03 07:46:49 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce90d10-bee9-4e23-9fe5-b8ee9a80d4bb]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0f06142-cb19-41ab-946c-e6874a7c2e24 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:49 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f Nov 03 07:46:49 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:49 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:49 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-77e5d7ce-a32c-4780-a6bf-338d029511c9 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-e7647b49-c3b6-4353-be1f-2cca240d9642" returned: 0 in 0.257s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.285s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-77e5d7ce-a32c-4780-a6bf-338d029511c9 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-e7647b49-c3b6-4353-be1f-2cca240d9642" released by "delete_volume" :: held 0.725s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 28 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-77e5d7ce-a32c-4780-a6bf-338d029511c9 tempest-ProjectReaderTests-1828620363 None] Created reservations ['7020b9e9-f5cc-400d-9730-d87953df4ae1', '283889be-e755-46d2-ac79-59acd254cc3a', 'adc94dcb-73d6-4699-98e2-224bcd57d123', '69633a43-8560-4532-b24f-ec1abf48dd9a'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-77e5d7ce-a32c-4780-a6bf-338d029511c9 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-77e5d7ce-a32c-4780-a6bf-338d029511c9 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-77e5d7ce-a32c-4780-a6bf-338d029511c9 tempest-ProjectReaderTests-1828620363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-77e5d7ce-a32c-4780-a6bf-338d029511c9 tempest-ProjectReaderTests-1828620363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-77e5d7ce-a32c-4780-a6bf-338d029511c9 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-77e5d7ce-a32c-4780-a6bf-338d029511c9 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:49 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:46:49 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:49 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0f06142-cb19-41ab-946c-e6874a7c2e24 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f" returned: 0 in 0.408s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0f06142-cb19-41ab-946c-e6874a7c2e24 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:49 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2 1G Nov 03 07:46:49 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:49 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-77e5d7ce-a32c-4780-a6bf-338d029511c9 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.254s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-77e5d7ce-a32c-4780-a6bf-338d029511c9 tempest-ProjectReaderTests-1828620363 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:49 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-77e5d7ce-a32c-4780-a6bf-338d029511c9 tempest-ProjectReaderTests-1828620363 None] Deleted volume successfully. Nov 03 07:46:49 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-77e5d7ce-a32c-4780-a6bf-338d029511c9 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-e7647b49-c3b6-4353-be1f-2cca240d9642-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:50 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0f06142-cb19-41ab-946c-e6874a7c2e24 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2 1G" returned: 0 in 0.451s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0f06142-cb19-41ab-946c-e6874a7c2e24 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-590d1ee4-507b-4b71-b66c-25351c4b296f -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:50 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-590d1ee4-507b-4b71-b66c-25351c4b296f -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2 Nov 03 07:46:50 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:50 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Flow 'volume_create_manager' (804fb7dd-e499-41ef-b158-6e1346c43583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fee8beac-8265-4f24-8486-87dc5511c78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:50 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0f06142-cb19-41ab-946c-e6874a7c2e24 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-590d1ee4-507b-4b71-b66c-25351c4b296f -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2" returned: 0 in 0.371s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:50 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-a0f06142-cb19-41ab-946c-e6874a7c2e24 tempest-ProjectMemberTests-2017513802 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2 is being set with open permissions: ugo+rw Nov 03 07:46:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0f06142-cb19-41ab-946c-e6874a7c2e24 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fee8beac-8265-4f24-8486-87dc5511c78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1355297777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b328f048-48e2-4a43-9253-627f8897e1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d016ba9019143bca2aab18a27b1a5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:50Z,use_quota=True,user_id='a802132e9b66410dbd73f46a439c9c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70aee09-c5e4-4882-8ff5-6da11472d459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:50 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2 Nov 03 07:46:50 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70aee09-c5e4-4882-8ff5-6da11472d459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b523f30-8fa6-4813-8343-520d524ab256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b523f30-8fa6-4813-8343-520d524ab256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b328f048-48e2-4a43-9253-627f8897e1d6', 'volume_name': 'volume-b328f048-48e2-4a43-9253-627f8897e1d6', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (680a37cc-d3f0-4dc4-a8f3-0d7e985394ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (680a37cc-d3f0-4dc4-a8f3-0d7e985394ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11725b20-da6d-4e7b-9286-2fdd53688d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:50 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Volume b328f048-48e2-4a43-9253-627f8897e1d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b328f048-48e2-4a43-9253-627f8897e1d6', 'volume_size': 1} Nov 03 07:46:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:50 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0f06142-cb19-41ab-946c-e6874a7c2e24 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2" returned: 0 in 0.266s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0f06142-cb19-41ab-946c-e6874a7c2e24 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:50 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.info Nov 03 07:46:50 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:50 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0f06142-cb19-41ab-946c-e6874a7c2e24 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.info" returned: 0 in 0.254s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:51 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-a0f06142-cb19-41ab-946c-e6874a7c2e24 tempest-ProjectMemberTests-2017513802 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.info is being set with open permissions: ugo+rw Nov 03 07:46:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0f06142-cb19-41ab-946c-e6874a7c2e24 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:51 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.info Nov 03 07:46:51 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:51 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a0f06142-cb19-41ab-946c-e6874a7c2e24 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.info" returned: 0 in 0.262s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a0f06142-cb19-41ab-946c-e6874a7c2e24 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.153s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.780s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1355297777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b328f048-48e2-4a43-9253-627f8897e1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d016ba9019143bca2aab18a27b1a5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:50Z,use_quota=True,user_id='a802132e9b66410dbd73f46a439c9c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:46:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Creating volume b328f048-48e2-4a43-9253-627f8897e1d6 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:51 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:46:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:51 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6 1073741824 Nov 03 07:46:51 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:51 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-a0f06142-cb19-41ab-946c-e6874a7c2e24 tempest-ProjectMemberTests-2017513802 None] Create snapshot completed successfully Nov 03 07:46:51 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6 1073741824" returned: 0 in 0.429s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:51 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6 Nov 03 07:46:51 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:52 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6" returned: 0 in 0.251s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11725b20-da6d-4e7b-9286-2fdd53688d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b328f048-48e2-4a43-9253-627f8897e1d6', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3d8c29-abd6-412f-ab13-7d16dc129c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:52 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Volume volume-b328f048-48e2-4a43-9253-627f8897e1d6 (b328f048-48e2-4a43-9253-627f8897e1d6): created successfully Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3d8c29-abd6-412f-ab13-7d16dc129c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Flow 'volume_create_manager' (804fb7dd-e499-41ef-b158-6e1346c43583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:52 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-3fe1f0a4-d4cb-4eb9-87a4-2a94c1388239 tempest-ProjectReaderTests-1828620363 None] Created volume successfully. Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e49b23fe-e033-43ca-addc-1724e286e51b tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e49b23fe-e033-43ca-addc-1724e286e51b tempest-ProjectMemberTests-2017513802 None] Lock "cinder-9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e49b23fe-e033-43ca-addc-1724e286e51b tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-590d1ee4-507b-4b71-b66c-25351c4b296f" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e49b23fe-e033-43ca-addc-1724e286e51b tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-590d1ee4-507b-4b71-b66c-25351c4b296f" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e49b23fe-e033-43ca-addc-1724e286e51b tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e49b23fe-e033-43ca-addc-1724e286e51b tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-e49b23fe-e033-43ca-addc-1724e286e51b tempest-ProjectMemberTests-2017513802 None] Deleting offline snapshot 9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2 of volume 590d1ee4-507b-4b71-b66c-25351c4b296f {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-e49b23fe-e033-43ca-addc-1724e286e51b tempest-ProjectMemberTests-2017513802 None] snapshot_file for this snap is: volume-590d1ee4-507b-4b71-b66c-25351c4b296f.9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[533f9e83-9e98-4e96-80ed-5832901bd46c]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e49b23fe-e033-43ca-addc-1724e286e51b tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:52 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2 Nov 03 07:46:52 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-30ff8711-f4cd-4450-a45f-bed2165fcf91 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-30ff8711-f4cd-4450-a45f-bed2165fcf91 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-30ff8711-f4cd-4450-a45f-bed2165fcf91 tempest-ProjectReaderTests-1828620363 None] Creating offline snapshot 767a3cc0-1881-47bc-a366-5f3b38a52f2a of volume b328f048-48e2-4a43-9253-627f8897e1d6 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f1a2c2-f170-4b11-ad54-ed5bc38c6815]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-30ff8711-f4cd-4450-a45f-bed2165fcf91 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:52 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6 Nov 03 07:46:52 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:52 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e49b23fe-e033-43ca-addc-1724e286e51b tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2" returned: 0 in 0.396s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-e49b23fe-e033-43ca-addc-1724e286e51b tempest-ProjectMemberTests-2017513802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-590d1ee4-507b-4b71-b66c-25351c4b296f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[64561b98-e695-49fd-a4f7-e2fb9008f318]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:52 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e49b23fe-e033-43ca-addc-1724e286e51b tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:52 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f Nov 03 07:46:52 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:53 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-30ff8711-f4cd-4450-a45f-bed2165fcf91 tempest-ProjectReaderTests-1828620363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6" returned: 0 in 0.369s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-30ff8711-f4cd-4450-a45f-bed2165fcf91 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.767a3cc0-1881-47bc-a366-5f3b38a52f2a 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:53 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.767a3cc0-1881-47bc-a366-5f3b38a52f2a 1G Nov 03 07:46:53 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:53 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e49b23fe-e033-43ca-addc-1724e286e51b tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f" returned: 0 in 0.420s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e49b23fe-e033-43ca-addc-1724e286e51b tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:53 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2 Nov 03 07:46:53 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:53 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-30ff8711-f4cd-4450-a45f-bed2165fcf91 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.767a3cc0-1881-47bc-a366-5f3b38a52f2a 1G" returned: 0 in 0.446s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-30ff8711-f4cd-4450-a45f-bed2165fcf91 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b328f048-48e2-4a43-9253-627f8897e1d6 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.767a3cc0-1881-47bc-a366-5f3b38a52f2a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:53 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b328f048-48e2-4a43-9253-627f8897e1d6 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.767a3cc0-1881-47bc-a366-5f3b38a52f2a Nov 03 07:46:53 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:53 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e49b23fe-e033-43ca-addc-1724e286e51b tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2" returned: 0 in 0.336s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e49b23fe-e033-43ca-addc-1724e286e51b tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:53 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2 Nov 03 07:46:53 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:53 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-30ff8711-f4cd-4450-a45f-bed2165fcf91 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b328f048-48e2-4a43-9253-627f8897e1d6 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.767a3cc0-1881-47bc-a366-5f3b38a52f2a" returned: 0 in 0.320s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:53 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-30ff8711-f4cd-4450-a45f-bed2165fcf91 tempest-ProjectReaderTests-1828620363 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.767a3cc0-1881-47bc-a366-5f3b38a52f2a is being set with open permissions: ugo+rw Nov 03 07:46:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-30ff8711-f4cd-4450-a45f-bed2165fcf91 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.767a3cc0-1881-47bc-a366-5f3b38a52f2a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:53 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.767a3cc0-1881-47bc-a366-5f3b38a52f2a Nov 03 07:46:53 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:53 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:53 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e49b23fe-e033-43ca-addc-1724e286e51b tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f.9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2" returned: 0 in 0.253s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e49b23fe-e033-43ca-addc-1724e286e51b tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2" released by "_delete_snapshot" :: held 1.511s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:53 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e49b23fe-e033-43ca-addc-1724e286e51b tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-590d1ee4-507b-4b71-b66c-25351c4b296f" released by "delete_snapshot" :: held 1.535s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:53 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-e49b23fe-e033-43ca-addc-1724e286e51b tempest-ProjectMemberTests-2017513802 None] Created reservations ['dd6dabba-2f2e-4eb8-8518-74a09548f92c', '4c1cce20-8d88-4a66-b4e7-f52c51ef9b92', '1a3ca870-24af-40d3-8c55-6bd142016689', 'e95c9f68-cea3-416c-ab5b-680d241a2c6a'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:54 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-e49b23fe-e033-43ca-addc-1724e286e51b tempest-ProjectMemberTests-2017513802 None] Delete snapshot completed successfully. Nov 03 07:46:54 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e49b23fe-e033-43ca-addc-1724e286e51b tempest-ProjectMemberTests-2017513802 None] Lock "cinder-9bb2fc87-f02e-489a-8fe3-f6d0bb2ef8a2-delete_snapshot" released by "delete_snapshot" :: held 1.687s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:54 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-30ff8711-f4cd-4450-a45f-bed2165fcf91 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.767a3cc0-1881-47bc-a366-5f3b38a52f2a" returned: 0 in 0.251s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-30ff8711-f4cd-4450-a45f-bed2165fcf91 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:54 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.info Nov 03 07:46:54 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:54 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-30ff8711-f4cd-4450-a45f-bed2165fcf91 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.info" returned: 0 in 0.261s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:54 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-30ff8711-f4cd-4450-a45f-bed2165fcf91 tempest-ProjectReaderTests-1828620363 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.info is being set with open permissions: ugo+rw Nov 03 07:46:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-30ff8711-f4cd-4450-a45f-bed2165fcf91 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:54 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.info Nov 03 07:46:54 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:54 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-009df713-09ca-4fb0-8ff0-0f66ebc663e6 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-590d1ee4-507b-4b71-b66c-25351c4b296f-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:54 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-009df713-09ca-4fb0-8ff0-0f66ebc663e6 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-590d1ee4-507b-4b71-b66c-25351c4b296f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:54 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-009df713-09ca-4fb0-8ff0-0f66ebc663e6 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-590d1ee4-507b-4b71-b66c-25351c4b296f" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:54 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-009df713-09ca-4fb0-8ff0-0f66ebc663e6 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-590d1ee4-507b-4b71-b66c-25351c4b296f" acquired by "delete_volume" :: waited 0.015s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:54 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-30ff8711-f4cd-4450-a45f-bed2165fcf91 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.info" returned: 0 in 0.279s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-30ff8711-f4cd-4450-a45f-bed2165fcf91 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:54 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ced4f6-e872-48ba-b296-7ca7c713c100]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:54 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-009df713-09ca-4fb0-8ff0-0f66ebc663e6 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:54 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-30ff8711-f4cd-4450-a45f-bed2165fcf91 tempest-ProjectReaderTests-1828620363 None] Create snapshot completed successfully Nov 03 07:46:54 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f Nov 03 07:46:54 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:55 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-009df713-09ca-4fb0-8ff0-0f66ebc663e6 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f" returned: 0 in 0.382s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-009df713-09ca-4fb0-8ff0-0f66ebc663e6 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:55 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f Nov 03 07:46:55 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:55 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-009df713-09ca-4fb0-8ff0-0f66ebc663e6 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-590d1ee4-507b-4b71-b66c-25351c4b296f" returned: 0 in 0.247s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-009df713-09ca-4fb0-8ff0-0f66ebc663e6 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-590d1ee4-507b-4b71-b66c-25351c4b296f" released by "delete_volume" :: held 0.707s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-009df713-09ca-4fb0-8ff0-0f66ebc663e6 tempest-ProjectMemberTests-2017513802 None] Created reservations ['2493f77d-8601-475f-a67d-33f77fd86484', '4e96780a-6fdd-4f32-8da1-86a23ec8c5a3', '3ed66f98-6adc-42f2-8f94-c7f350705091', '3dda5cbb-5ffd-412c-a2b5-5e415fad1f96'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-009df713-09ca-4fb0-8ff0-0f66ebc663e6 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-009df713-09ca-4fb0-8ff0-0f66ebc663e6 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-009df713-09ca-4fb0-8ff0-0f66ebc663e6 tempest-ProjectMemberTests-2017513802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-009df713-09ca-4fb0-8ff0-0f66ebc663e6 tempest-ProjectMemberTests-2017513802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-009df713-09ca-4fb0-8ff0-0f66ebc663e6 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-009df713-09ca-4fb0-8ff0-0f66ebc663e6 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:55 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:46:55 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:55 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-009df713-09ca-4fb0-8ff0-0f66ebc663e6 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.253s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-009df713-09ca-4fb0-8ff0-0f66ebc663e6 tempest-ProjectMemberTests-2017513802 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:55 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-009df713-09ca-4fb0-8ff0-0f66ebc663e6 tempest-ProjectMemberTests-2017513802 None] Deleted volume successfully. Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-009df713-09ca-4fb0-8ff0-0f66ebc663e6 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-590d1ee4-507b-4b71-b66c-25351c4b296f-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c114983e-cbea-4cf8-8d15-ee31a31f4d87 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-767a3cc0-1881-47bc-a366-5f3b38a52f2a-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c114983e-cbea-4cf8-8d15-ee31a31f4d87 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-767a3cc0-1881-47bc-a366-5f3b38a52f2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c114983e-cbea-4cf8-8d15-ee31a31f4d87 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-quobyte-b328f048-48e2-4a43-9253-627f8897e1d6" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c114983e-cbea-4cf8-8d15-ee31a31f4d87 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-b328f048-48e2-4a43-9253-627f8897e1d6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c114983e-cbea-4cf8-8d15-ee31a31f4d87 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-quobyte-767a3cc0-1881-47bc-a366-5f3b38a52f2a" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c114983e-cbea-4cf8-8d15-ee31a31f4d87 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-767a3cc0-1881-47bc-a366-5f3b38a52f2a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-c114983e-cbea-4cf8-8d15-ee31a31f4d87 tempest-ProjectReaderTests-1828620363 None] Deleting offline snapshot 767a3cc0-1881-47bc-a366-5f3b38a52f2a of volume b328f048-48e2-4a43-9253-627f8897e1d6 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-c114983e-cbea-4cf8-8d15-ee31a31f4d87 tempest-ProjectReaderTests-1828620363 None] snapshot_file for this snap is: volume-b328f048-48e2-4a43-9253-627f8897e1d6.767a3cc0-1881-47bc-a366-5f3b38a52f2a {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58b1aac-29e0-4009-9e21-633df0a1759d]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:55 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c114983e-cbea-4cf8-8d15-ee31a31f4d87 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.767a3cc0-1881-47bc-a366-5f3b38a52f2a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:56 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.767a3cc0-1881-47bc-a366-5f3b38a52f2a Nov 03 07:46:56 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Flow 'volume_create_manager' (323ffb12-5419-48be-82cd-aa5aea704495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff761c4-6004-474e-a9fa-94d24bea22f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff761c4-6004-474e-a9fa-94d24bea22f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-593630446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a9a557-396a-48b3-b477-24e234b52687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed98c25bc1c64da3a0227cf8c7bef103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:56Z,use_quota=True,user_id='3b3ce7b9c2864a2db5285861bf4701c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1147ba-dcdd-41c3-9fbc-6554625791f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1147ba-dcdd-41c3-9fbc-6554625791f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3249374-0239-4285-9810-5ec7f009c565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3249374-0239-4285-9810-5ec7f009c565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8a9a557-396a-48b3-b477-24e234b52687', 'volume_name': 'volume-d8a9a557-396a-48b3-b477-24e234b52687', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49243322-6885-4331-a885-c064c62f1ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49243322-6885-4331-a885-c064c62f1ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a94b05-b17a-4742-a996-4e5e1831b3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:56 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Volume d8a9a557-396a-48b3-b477-24e234b52687: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8a9a557-396a-48b3-b477-24e234b52687', 'volume_size': 1} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-593630446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a9a557-396a-48b3-b477-24e234b52687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed98c25bc1c64da3a0227cf8c7bef103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:56Z,use_quota=True,user_id='3b3ce7b9c2864a2db5285861bf4701c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Creating volume d8a9a557-396a-48b3-b477-24e234b52687 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:56 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:56 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687 1073741824 Nov 03 07:46:56 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:56 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c114983e-cbea-4cf8-8d15-ee31a31f4d87 tempest-ProjectReaderTests-1828620363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.767a3cc0-1881-47bc-a366-5f3b38a52f2a" returned: 0 in 0.480s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-c114983e-cbea-4cf8-8d15-ee31a31f4d87 tempest-ProjectReaderTests-1828620363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b328f048-48e2-4a43-9253-627f8897e1d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e2091e-8848-4778-a07f-d44573b67c14]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c114983e-cbea-4cf8-8d15-ee31a31f4d87 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:56 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6 Nov 03 07:46:56 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:56 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687 1073741824" returned: 0 in 0.504s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:56 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c114983e-cbea-4cf8-8d15-ee31a31f4d87 tempest-ProjectReaderTests-1828620363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6" returned: 0 in 0.394s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c114983e-cbea-4cf8-8d15-ee31a31f4d87 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.767a3cc0-1881-47bc-a366-5f3b38a52f2a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:56 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.767a3cc0-1881-47bc-a366-5f3b38a52f2a Nov 03 07:46:56 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:56 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:56 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687 Nov 03 07:46:56 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:57 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687" returned: 0 in 0.256s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:57 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:46:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a94b05-b17a-4742-a996-4e5e1831b3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8a9a557-396a-48b3-b477-24e234b52687', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10df6fc5-65fb-422b-92c4-241a7db93138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:57 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Volume volume-d8a9a557-396a-48b3-b477-24e234b52687 (d8a9a557-396a-48b3-b477-24e234b52687): created successfully Nov 03 07:46:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10df6fc5-65fb-422b-92c4-241a7db93138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Flow 'volume_create_manager' (323ffb12-5419-48be-82cd-aa5aea704495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:57 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-96b3c4df-eb93-4955-b742-54bce799ec96 tempest-ProjectMemberTests-2017513802 None] Created volume successfully. Nov 03 07:46:57 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c114983e-cbea-4cf8-8d15-ee31a31f4d87 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.767a3cc0-1881-47bc-a366-5f3b38a52f2a" returned: 0 in 0.379s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c114983e-cbea-4cf8-8d15-ee31a31f4d87 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.767a3cc0-1881-47bc-a366-5f3b38a52f2a {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:57 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.767a3cc0-1881-47bc-a366-5f3b38a52f2a Nov 03 07:46:57 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:57 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-c114983e-cbea-4cf8-8d15-ee31a31f4d87 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6.767a3cc0-1881-47bc-a366-5f3b38a52f2a" returned: 0 in 0.243s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c114983e-cbea-4cf8-8d15-ee31a31f4d87 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-767a3cc0-1881-47bc-a366-5f3b38a52f2a" released by "_delete_snapshot" :: held 1.631s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c114983e-cbea-4cf8-8d15-ee31a31f4d87 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-b328f048-48e2-4a43-9253-627f8897e1d6" released by "delete_snapshot" :: held 1.656s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:57 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-c114983e-cbea-4cf8-8d15-ee31a31f4d87 tempest-ProjectReaderTests-1828620363 None] Created reservations ['2867a29f-9344-4ca6-bbd5-f87b629ce082', '3cda4039-c021-421d-9e69-a2cac25b8471', 'fca58996-5b0e-43a3-9c37-d9e2cc4d6113', 'a62976e9-e366-4b12-ae03-feccd0c99e42'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:57 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-c114983e-cbea-4cf8-8d15-ee31a31f4d87 tempest-ProjectReaderTests-1828620363 None] Delete snapshot completed successfully. Nov 03 07:46:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-c114983e-cbea-4cf8-8d15-ee31a31f4d87 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-767a3cc0-1881-47bc-a366-5f3b38a52f2a-delete_snapshot" released by "delete_snapshot" :: held 1.801s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-100841ec-3e3b-4cd0-82b4-a75594561932 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-b328f048-48e2-4a43-9253-627f8897e1d6-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-100841ec-3e3b-4cd0-82b4-a75594561932 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-b328f048-48e2-4a43-9253-627f8897e1d6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-100841ec-3e3b-4cd0-82b4-a75594561932 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-quobyte-b328f048-48e2-4a43-9253-627f8897e1d6" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:58 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-100841ec-3e3b-4cd0-82b4-a75594561932 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-b328f048-48e2-4a43-9253-627f8897e1d6" acquired by "delete_volume" :: waited 0.017s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:58 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1c49d9-122a-4795-b4f3-cb4973590315]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-100841ec-3e3b-4cd0-82b4-a75594561932 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:58 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6 Nov 03 07:46:58 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4d4190da-2c5d-4291-b3f1-5ad5ed039218 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4d4190da-2c5d-4291-b3f1-5ad5ed039218 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-4d4190da-2c5d-4291-b3f1-5ad5ed039218 tempest-ProjectMemberTests-2017513802 None] Creating offline snapshot 4b4e68b9-8f88-484f-9feb-16bf3e4afa3c of volume d8a9a557-396a-48b3-b477-24e234b52687 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:46:58 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb5adbf-6cb9-4560-8c75-e6f6577e3cca]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4d4190da-2c5d-4291-b3f1-5ad5ed039218 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:58 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-100841ec-3e3b-4cd0-82b4-a75594561932 tempest-ProjectReaderTests-1828620363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6" returned: 0 in 0.385s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-100841ec-3e3b-4cd0-82b4-a75594561932 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:58 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6 Nov 03 07:46:58 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:58 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687 Nov 03 07:46:58 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:58 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-100841ec-3e3b-4cd0-82b4-a75594561932 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-b328f048-48e2-4a43-9253-627f8897e1d6" returned: 0 in 0.244s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:58 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-100841ec-3e3b-4cd0-82b4-a75594561932 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-b328f048-48e2-4a43-9253-627f8897e1d6" released by "delete_volume" :: held 0.694s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:58 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-100841ec-3e3b-4cd0-82b4-a75594561932 tempest-ProjectReaderTests-1828620363 None] Created reservations ['d98d6071-e599-4879-a69c-df0f60808a08', 'df63261f-ed52-4652-9056-599970d9253a', '8b71482f-c50e-43b7-8eb2-7260cbb02c40', '779afb02-6ac6-4106-9ce2-339d5ecb6fb1'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:58 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4d4190da-2c5d-4291-b3f1-5ad5ed039218 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687" returned: 0 in 0.374s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4d4190da-2c5d-4291-b3f1-5ad5ed039218 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.4b4e68b9-8f88-484f-9feb-16bf3e4afa3c 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:58 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.4b4e68b9-8f88-484f-9feb-16bf3e4afa3c 1G Nov 03 07:46:58 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-100841ec-3e3b-4cd0-82b4-a75594561932 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-100841ec-3e3b-4cd0-82b4-a75594561932 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-100841ec-3e3b-4cd0-82b4-a75594561932 tempest-ProjectReaderTests-1828620363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-100841ec-3e3b-4cd0-82b4-a75594561932 tempest-ProjectReaderTests-1828620363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-100841ec-3e3b-4cd0-82b4-a75594561932 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-100841ec-3e3b-4cd0-82b4-a75594561932 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:58 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:46:58 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:59 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-100841ec-3e3b-4cd0-82b4-a75594561932 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.247s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:59 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-100841ec-3e3b-4cd0-82b4-a75594561932 tempest-ProjectReaderTests-1828620363 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:59 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-100841ec-3e3b-4cd0-82b4-a75594561932 tempest-ProjectReaderTests-1828620363 None] Deleted volume successfully. Nov 03 07:46:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-100841ec-3e3b-4cd0-82b4-a75594561932 tempest-ProjectReaderTests-1828620363 None] Lock "cinder-b328f048-48e2-4a43-9253-627f8897e1d6-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:59 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4d4190da-2c5d-4291-b3f1-5ad5ed039218 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.4b4e68b9-8f88-484f-9feb-16bf3e4afa3c 1G" returned: 0 in 0.462s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4d4190da-2c5d-4291-b3f1-5ad5ed039218 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8a9a557-396a-48b3-b477-24e234b52687 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.4b4e68b9-8f88-484f-9feb-16bf3e4afa3c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:59 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8a9a557-396a-48b3-b477-24e234b52687 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.4b4e68b9-8f88-484f-9feb-16bf3e4afa3c Nov 03 07:46:59 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:59 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:59 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Flow 'volume_create_manager' (28278be1-8fa1-4cf9-8b8d-b3d7239cfaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71647353-360e-4fd8-819d-667292041fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4d4190da-2c5d-4291-b3f1-5ad5ed039218 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8a9a557-396a-48b3-b477-24e234b52687 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.4b4e68b9-8f88-484f-9feb-16bf3e4afa3c" returned: 0 in 0.376s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:59 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-4d4190da-2c5d-4291-b3f1-5ad5ed039218 tempest-ProjectMemberTests-2017513802 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.4b4e68b9-8f88-484f-9feb-16bf3e4afa3c is being set with open permissions: ugo+rw Nov 03 07:46:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4d4190da-2c5d-4291-b3f1-5ad5ed039218 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.4b4e68b9-8f88-484f-9feb-16bf3e4afa3c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71647353-360e-4fd8-819d-667292041fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-346805336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d016ba9019143bca2aab18a27b1a5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:00Z,use_quota=True,user_id='a802132e9b66410dbd73f46a439c9c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:59 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.4b4e68b9-8f88-484f-9feb-16bf3e4afa3c Nov 03 07:46:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885ae67a-9773-4b29-aa0b-4b6b9ce49e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:59 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885ae67a-9773-4b29-aa0b-4b6b9ce49e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd493149-5357-476e-ab30-a95da8c90a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd493149-5357-476e-ab30-a95da8c90a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6', 'volume_name': 'volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d47131-a651-4546-bd1e-f9a99bb4b0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d47131-a651-4546-bd1e-f9a99bb4b0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:59 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32971aa8-cd51-45e3-a39f-6a76aeff5062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:59 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Volume 93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6', 'volume_size': 1} Nov 03 07:46:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:59 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4d4190da-2c5d-4291-b3f1-5ad5ed039218 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.4b4e68b9-8f88-484f-9feb-16bf3e4afa3c" returned: 0 in 0.283s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4d4190da-2c5d-4291-b3f1-5ad5ed039218 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:59 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.info Nov 03 07:46:59 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:00 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4d4190da-2c5d-4291-b3f1-5ad5ed039218 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.info" returned: 0 in 0.254s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:00 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-4d4190da-2c5d-4291-b3f1-5ad5ed039218 tempest-ProjectMemberTests-2017513802 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.info is being set with open permissions: ugo+rw Nov 03 07:47:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4d4190da-2c5d-4291-b3f1-5ad5ed039218 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:00 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.info Nov 03 07:47:00 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:00 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-4d4190da-2c5d-4291-b3f1-5ad5ed039218 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.info" returned: 0 in 0.238s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-4d4190da-2c5d-4291-b3f1-5ad5ed039218 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.075s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.761s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-346805336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d016ba9019143bca2aab18a27b1a5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:00Z,use_quota=True,user_id='a802132e9b66410dbd73f46a439c9c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:47:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Creating volume 93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:47:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:00 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:47:00 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:47:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:00 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:UPDATE=271,cinder:SELECT=209,cinder:INSERT=78,cinder:DELETE=20 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:47:00 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6 1073741824 Nov 03 07:47:00 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:00 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=212,cinder:INSERT=78,cinder:UPDATE=290,cinder:DELETE=25 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:47:00 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-4d4190da-2c5d-4291-b3f1-5ad5ed039218 tempest-ProjectMemberTests-2017513802 None] Create snapshot completed successfully Nov 03 07:47:00 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6 1073741824" returned: 0 in 0.442s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:00 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6 Nov 03 07:47:00 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:01 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6" returned: 0 in 0.251s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:01 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:47:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32971aa8-cd51-45e3-a39f-6a76aeff5062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227054fc-b973-4140-ae75-a99690fd8002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:01 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Volume volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6 (93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6): created successfully Nov 03 07:47:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227054fc-b973-4140-ae75-a99690fd8002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:01 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Flow 'volume_create_manager' (28278be1-8fa1-4cf9-8b8d-b3d7239cfaa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:01 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-9dfac35e-bb2c-422b-b8a0-30d6589d69a6 tempest-ProjectReaderTests-1828620363 None] Created volume successfully. Nov 03 07:47:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b45e6bae-708a-49c9-a250-87c0f17a03fe tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-4b4e68b9-8f88-484f-9feb-16bf3e4afa3c-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b45e6bae-708a-49c9-a250-87c0f17a03fe tempest-ProjectMemberTests-2017513802 None] Lock "cinder-4b4e68b9-8f88-484f-9feb-16bf3e4afa3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b45e6bae-708a-49c9-a250-87c0f17a03fe tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-d8a9a557-396a-48b3-b477-24e234b52687" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b45e6bae-708a-49c9-a250-87c0f17a03fe tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-d8a9a557-396a-48b3-b477-24e234b52687" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b45e6bae-708a-49c9-a250-87c0f17a03fe tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-4b4e68b9-8f88-484f-9feb-16bf3e4afa3c" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b45e6bae-708a-49c9-a250-87c0f17a03fe tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-4b4e68b9-8f88-484f-9feb-16bf3e4afa3c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:01 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-b45e6bae-708a-49c9-a250-87c0f17a03fe tempest-ProjectMemberTests-2017513802 None] Deleting offline snapshot 4b4e68b9-8f88-484f-9feb-16bf3e4afa3c of volume d8a9a557-396a-48b3-b477-24e234b52687 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:47:01 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-b45e6bae-708a-49c9-a250-87c0f17a03fe tempest-ProjectMemberTests-2017513802 None] snapshot_file for this snap is: volume-d8a9a557-396a-48b3-b477-24e234b52687.4b4e68b9-8f88-484f-9feb-16bf3e4afa3c {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:47:01 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd90d7a-da26-440c-ad91-88c1e0b41e71]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b45e6bae-708a-49c9-a250-87c0f17a03fe tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.4b4e68b9-8f88-484f-9feb-16bf3e4afa3c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:01 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.4b4e68b9-8f88-484f-9feb-16bf3e4afa3c Nov 03 07:47:01 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f488ca23-0a1b-4b42-b82f-47b7a1877d56 tempest-ProjectReaderTests-1828620363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f488ca23-0a1b-4b42-b82f-47b7a1877d56 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:01 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-f488ca23-0a1b-4b42-b82f-47b7a1877d56 tempest-ProjectReaderTests-1828620363 None] Creating offline snapshot a9039478-3efa-4e5f-a01c-11e8bb45aa28 of volume 93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:47:01 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fa447a-b84f-437a-8c46-d492f13f9d1b]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f488ca23-0a1b-4b42-b82f-47b7a1877d56 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:01 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6 Nov 03 07:47:02 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:02 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b45e6bae-708a-49c9-a250-87c0f17a03fe tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.4b4e68b9-8f88-484f-9feb-16bf3e4afa3c" returned: 0 in 0.384s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:02 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-b45e6bae-708a-49c9-a250-87c0f17a03fe tempest-ProjectMemberTests-2017513802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8a9a557-396a-48b3-b477-24e234b52687(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:47:02 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[876d884e-512d-47be-84a1-8e249389daa5]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b45e6bae-708a-49c9-a250-87c0f17a03fe tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:02 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687 Nov 03 07:47:02 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:02 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f488ca23-0a1b-4b42-b82f-47b7a1877d56 tempest-ProjectReaderTests-1828620363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6" returned: 0 in 0.394s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f488ca23-0a1b-4b42-b82f-47b7a1877d56 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.a9039478-3efa-4e5f-a01c-11e8bb45aa28 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:02 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.a9039478-3efa-4e5f-a01c-11e8bb45aa28 1G Nov 03 07:47:02 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:02 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b45e6bae-708a-49c9-a250-87c0f17a03fe tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687" returned: 0 in 0.417s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b45e6bae-708a-49c9-a250-87c0f17a03fe tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.4b4e68b9-8f88-484f-9feb-16bf3e4afa3c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:02 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.4b4e68b9-8f88-484f-9feb-16bf3e4afa3c Nov 03 07:47:02 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:02 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f488ca23-0a1b-4b42-b82f-47b7a1877d56 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.a9039478-3efa-4e5f-a01c-11e8bb45aa28 1G" returned: 0 in 0.440s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f488ca23-0a1b-4b42-b82f-47b7a1877d56 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.a9039478-3efa-4e5f-a01c-11e8bb45aa28 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:02 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.a9039478-3efa-4e5f-a01c-11e8bb45aa28 Nov 03 07:47:02 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:02 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b45e6bae-708a-49c9-a250-87c0f17a03fe tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.4b4e68b9-8f88-484f-9feb-16bf3e4afa3c" returned: 0 in 0.389s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b45e6bae-708a-49c9-a250-87c0f17a03fe tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.4b4e68b9-8f88-484f-9feb-16bf3e4afa3c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:02 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.4b4e68b9-8f88-484f-9feb-16bf3e4afa3c Nov 03 07:47:02 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:03 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f488ca23-0a1b-4b42-b82f-47b7a1877d56 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.a9039478-3efa-4e5f-a01c-11e8bb45aa28" returned: 0 in 0.310s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:03 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-f488ca23-0a1b-4b42-b82f-47b7a1877d56 tempest-ProjectReaderTests-1828620363 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.a9039478-3efa-4e5f-a01c-11e8bb45aa28 is being set with open permissions: ugo+rw Nov 03 07:47:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f488ca23-0a1b-4b42-b82f-47b7a1877d56 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.a9039478-3efa-4e5f-a01c-11e8bb45aa28 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:03 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.a9039478-3efa-4e5f-a01c-11e8bb45aa28 Nov 03 07:47:03 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:03 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-b45e6bae-708a-49c9-a250-87c0f17a03fe tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687.4b4e68b9-8f88-484f-9feb-16bf3e4afa3c" returned: 0 in 0.311s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b45e6bae-708a-49c9-a250-87c0f17a03fe tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-4b4e68b9-8f88-484f-9feb-16bf3e4afa3c" released by "_delete_snapshot" :: held 1.629s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b45e6bae-708a-49c9-a250-87c0f17a03fe tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-d8a9a557-396a-48b3-b477-24e234b52687" released by "delete_snapshot" :: held 1.656s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:03 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f488ca23-0a1b-4b42-b82f-47b7a1877d56 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.a9039478-3efa-4e5f-a01c-11e8bb45aa28" returned: 0 in 0.280s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:03 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-b45e6bae-708a-49c9-a250-87c0f17a03fe tempest-ProjectMemberTests-2017513802 None] Created reservations ['ddf3fb1c-8516-410e-aa23-3b6d162d0416', '42832a49-de36-421c-9709-5c712ab306e5', 'c55aa983-2a85-482a-8baf-b1489a561733', 'da087100-0013-4ce1-ba38-83f5cfadf744'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:47:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f488ca23-0a1b-4b42-b82f-47b7a1877d56 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:03 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.info Nov 03 07:47:03 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:03 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-b45e6bae-708a-49c9-a250-87c0f17a03fe tempest-ProjectMemberTests-2017513802 None] Delete snapshot completed successfully. Nov 03 07:47:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-b45e6bae-708a-49c9-a250-87c0f17a03fe tempest-ProjectMemberTests-2017513802 None] Lock "cinder-4b4e68b9-8f88-484f-9feb-16bf3e4afa3c-delete_snapshot" released by "delete_snapshot" :: held 1.873s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:03 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f488ca23-0a1b-4b42-b82f-47b7a1877d56 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.info" returned: 0 in 0.267s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:03 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-f488ca23-0a1b-4b42-b82f-47b7a1877d56 tempest-ProjectReaderTests-1828620363 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.info is being set with open permissions: ugo+rw Nov 03 07:47:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f488ca23-0a1b-4b42-b82f-47b7a1877d56 tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:03 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.info Nov 03 07:47:03 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-8a0f3309-34b1-4651-a9ae-a9b55d152231 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-d8a9a557-396a-48b3-b477-24e234b52687-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-8a0f3309-34b1-4651-a9ae-a9b55d152231 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-d8a9a557-396a-48b3-b477-24e234b52687-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-8a0f3309-34b1-4651-a9ae-a9b55d152231 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-d8a9a557-396a-48b3-b477-24e234b52687" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:03 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-8a0f3309-34b1-4651-a9ae-a9b55d152231 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-d8a9a557-396a-48b3-b477-24e234b52687" acquired by "delete_volume" :: waited 0.016s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:03 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[332977c9-47df-47ef-9589-fd63496bbc4f]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8a0f3309-34b1-4651-a9ae-a9b55d152231 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:03 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f488ca23-0a1b-4b42-b82f-47b7a1877d56 tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.info" returned: 0 in 0.317s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:03 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687 Nov 03 07:47:03 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:03 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f488ca23-0a1b-4b42-b82f-47b7a1877d56 tempest-ProjectReaderTests-1828620363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.107s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:03 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-f488ca23-0a1b-4b42-b82f-47b7a1877d56 tempest-ProjectReaderTests-1828620363 None] Create snapshot completed successfully Nov 03 07:47:04 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8a0f3309-34b1-4651-a9ae-a9b55d152231 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687" returned: 0 in 0.412s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8a0f3309-34b1-4651-a9ae-a9b55d152231 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:04 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687 Nov 03 07:47:04 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:04 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8a0f3309-34b1-4651-a9ae-a9b55d152231 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-d8a9a557-396a-48b3-b477-24e234b52687" returned: 0 in 0.292s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:04 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-8a0f3309-34b1-4651-a9ae-a9b55d152231 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-d8a9a557-396a-48b3-b477-24e234b52687" released by "delete_volume" :: held 0.767s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:04 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-8a0f3309-34b1-4651-a9ae-a9b55d152231 tempest-ProjectMemberTests-2017513802 None] Created reservations ['a7d1bd42-0332-4e50-a975-80f7c7ba56af', 'b3a67bec-66af-464f-8611-fb8824d60f80', '78cf5f32-a3ce-424d-8a17-d52db3df759d', '7a8c638d-66cb-4dc6-9390-136fcdbdfef0'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:47:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8a0f3309-34b1-4651-a9ae-a9b55d152231 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8a0f3309-34b1-4651-a9ae-a9b55d152231 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:04 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8a0f3309-34b1-4651-a9ae-a9b55d152231 tempest-ProjectMemberTests-2017513802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:04 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-8a0f3309-34b1-4651-a9ae-a9b55d152231 tempest-ProjectMemberTests-2017513802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-8a0f3309-34b1-4651-a9ae-a9b55d152231 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8a0f3309-34b1-4651-a9ae-a9b55d152231 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:04 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:47:04 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:04 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:04 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-8a0f3309-34b1-4651-a9ae-a9b55d152231 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.291s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:04 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-8a0f3309-34b1-4651-a9ae-a9b55d152231 tempest-ProjectMemberTests-2017513802 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:47:04 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-8a0f3309-34b1-4651-a9ae-a9b55d152231 tempest-ProjectMemberTests-2017513802 None] Deleted volume successfully. Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-8a0f3309-34b1-4651-a9ae-a9b55d152231 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-d8a9a557-396a-48b3-b477-24e234b52687-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e5940d16-59f1-49ff-92f5-53a20a134d3f tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-a9039478-3efa-4e5f-a01c-11e8bb45aa28-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e5940d16-59f1-49ff-92f5-53a20a134d3f tempest-ProjectReaderTests-1828620363 None] Lock "cinder-a9039478-3efa-4e5f-a01c-11e8bb45aa28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e5940d16-59f1-49ff-92f5-53a20a134d3f tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-quobyte-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e5940d16-59f1-49ff-92f5-53a20a134d3f tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e5940d16-59f1-49ff-92f5-53a20a134d3f tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-quobyte-a9039478-3efa-4e5f-a01c-11e8bb45aa28" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e5940d16-59f1-49ff-92f5-53a20a134d3f tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-a9039478-3efa-4e5f-a01c-11e8bb45aa28" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-e5940d16-59f1-49ff-92f5-53a20a134d3f tempest-ProjectReaderTests-1828620363 None] Deleting offline snapshot a9039478-3efa-4e5f-a01c-11e8bb45aa28 of volume 93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-e5940d16-59f1-49ff-92f5-53a20a134d3f tempest-ProjectReaderTests-1828620363 None] snapshot_file for this snap is: volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.a9039478-3efa-4e5f-a01c-11e8bb45aa28 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[b124b9fd-99d8-4255-be40-06665dd91526]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e5940d16-59f1-49ff-92f5-53a20a134d3f tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.a9039478-3efa-4e5f-a01c-11e8bb45aa28 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:05 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.a9039478-3efa-4e5f-a01c-11e8bb45aa28 Nov 03 07:47:05 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Flow 'volume_create_manager' (50c5033f-fb94-45c5-a9d0-69095707e841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2591d030-8312-4cec-b11a-aa87a12f18fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2591d030-8312-4cec-b11a-aa87a12f18fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557464652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaaf2091-224b-49d9-988b-d0d50998add0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed98c25bc1c64da3a0227cf8c7bef103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:05Z,use_quota=True,user_id='3b3ce7b9c2864a2db5285861bf4701c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0c7e80-825c-492a-948b-ddb5e2fb811d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0c7e80-825c-492a-948b-ddb5e2fb811d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15605c30-df0a-45d3-b5cd-4b3d0f3bef04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15605c30-df0a-45d3-b5cd-4b3d0f3bef04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaaf2091-224b-49d9-988b-d0d50998add0', 'volume_name': 'volume-aaaf2091-224b-49d9-988b-d0d50998add0', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a584b8e-b6cc-4a3b-9c0e-9d1747348643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a584b8e-b6cc-4a3b-9c0e-9d1747348643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb28e02-f7a6-4d7e-99c0-2c829f8908b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:05 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Volume aaaf2091-224b-49d9-988b-d0d50998add0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaaf2091-224b-49d9-988b-d0d50998add0', 'volume_size': 1} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:05 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557464652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaaf2091-224b-49d9-988b-d0d50998add0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed98c25bc1c64da3a0227cf8c7bef103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:05Z,use_quota=True,user_id='3b3ce7b9c2864a2db5285861bf4701c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Creating volume aaaf2091-224b-49d9-988b-d0d50998add0 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:47:05 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e5940d16-59f1-49ff-92f5-53a20a134d3f tempest-ProjectReaderTests-1828620363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.a9039478-3efa-4e5f-a01c-11e8bb45aa28" returned: 0 in 0.438s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-e5940d16-59f1-49ff-92f5-53a20a134d3f tempest-ProjectReaderTests-1828620363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:47:05 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0 1073741824 Nov 03 07:47:05 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[89963ee1-6f6f-4c45-9b6b-3aba0353d66d]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:05 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e5940d16-59f1-49ff-92f5-53a20a134d3f tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:05 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6 Nov 03 07:47:05 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:06 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e5940d16-59f1-49ff-92f5-53a20a134d3f tempest-ProjectReaderTests-1828620363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6" returned: 0 in 0.398s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e5940d16-59f1-49ff-92f5-53a20a134d3f tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.a9039478-3efa-4e5f-a01c-11e8bb45aa28 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:06 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.a9039478-3efa-4e5f-a01c-11e8bb45aa28 Nov 03 07:47:06 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:06 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0 1073741824" returned: 0 in 0.482s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:06 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0 Nov 03 07:47:06 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:06 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0" returned: 0 in 0.275s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:06 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:47:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb28e02-f7a6-4d7e-99c0-2c829f8908b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaaf2091-224b-49d9-988b-d0d50998add0', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cfb534-3242-474e-af25-a033ecc4e2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:06 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e5940d16-59f1-49ff-92f5-53a20a134d3f tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.a9039478-3efa-4e5f-a01c-11e8bb45aa28" returned: 0 in 0.395s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e5940d16-59f1-49ff-92f5-53a20a134d3f tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.a9039478-3efa-4e5f-a01c-11e8bb45aa28 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:06 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Volume volume-aaaf2091-224b-49d9-988b-d0d50998add0 (aaaf2091-224b-49d9-988b-d0d50998add0): created successfully Nov 03 07:47:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cfb534-3242-474e-af25-a033ecc4e2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:06 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.a9039478-3efa-4e5f-a01c-11e8bb45aa28 Nov 03 07:47:06 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Flow 'volume_create_manager' (50c5033f-fb94-45c5-a9d0-69095707e841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:06 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:06 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-d31c485e-0513-4cc4-98f7-63712720ac31 tempest-ProjectMemberTests-2017513802 None] Created volume successfully. Nov 03 07:47:06 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:06 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-e5940d16-59f1-49ff-92f5-53a20a134d3f tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6.a9039478-3efa-4e5f-a01c-11e8bb45aa28" returned: 0 in 0.248s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:06 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e5940d16-59f1-49ff-92f5-53a20a134d3f tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-a9039478-3efa-4e5f-a01c-11e8bb45aa28" released by "_delete_snapshot" :: held 1.598s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:06 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e5940d16-59f1-49ff-92f5-53a20a134d3f tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6" released by "delete_snapshot" :: held 1.625s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:06 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-e5940d16-59f1-49ff-92f5-53a20a134d3f tempest-ProjectReaderTests-1828620363 None] Created reservations ['cf92433a-930b-4dc9-9408-a8f88a86a71c', 'ebd99ac3-18eb-4a7a-a3ad-93e95f50fa00', '2c1e2ffc-3380-4c79-9bf7-fa16dbd02d64', '5ab4ce96-581d-4989-9869-35140a06c998'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:47:06 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-e5940d16-59f1-49ff-92f5-53a20a134d3f tempest-ProjectReaderTests-1828620363 None] Delete snapshot completed successfully. Nov 03 07:47:06 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-e5940d16-59f1-49ff-92f5-53a20a134d3f tempest-ProjectReaderTests-1828620363 None] Lock "cinder-a9039478-3efa-4e5f-a01c-11e8bb45aa28-delete_snapshot" released by "delete_snapshot" :: held 1.767s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:07 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-009d13ba-3100-41f3-bace-252444d3857c tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:07 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-009d13ba-3100-41f3-bace-252444d3857c tempest-ProjectReaderTests-1828620363 None] Lock "cinder-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:07 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-009d13ba-3100-41f3-bace-252444d3857c tempest-ProjectReaderTests-1828620363 None] Acquiring lock "cinder-quobyte-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:07 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-009d13ba-3100-41f3-bace-252444d3857c tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6" acquired by "delete_volume" :: waited 0.019s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:07 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[642cb145-b854-449c-ab06-2f9d24ab2419]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-009d13ba-3100-41f3-bace-252444d3857c tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:07 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6 Nov 03 07:47:07 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:07 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-009d13ba-3100-41f3-bace-252444d3857c tempest-ProjectReaderTests-1828620363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6" returned: 0 in 0.400s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-009d13ba-3100-41f3-bace-252444d3857c tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3eb22e2a-9383-48d9-a4d7-094ca83d3754 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3eb22e2a-9383-48d9-a4d7-094ca83d3754 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:07 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6 Nov 03 07:47:07 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:07 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-3eb22e2a-9383-48d9-a4d7-094ca83d3754 tempest-ProjectMemberTests-2017513802 None] Creating offline snapshot 1fba810d-a586-4110-8d13-43200a6237df of volume aaaf2091-224b-49d9-988b-d0d50998add0 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:47:07 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3adeb9f-530f-4de0-a66d-41f0345241e8]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3eb22e2a-9383-48d9-a4d7-094ca83d3754 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:07 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0 Nov 03 07:47:07 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:07 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:07 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-009d13ba-3100-41f3-bace-252444d3857c tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6" returned: 0 in 0.256s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:08 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-009d13ba-3100-41f3-bace-252444d3857c tempest-ProjectReaderTests-1828620363 None] Lock "cinder-quobyte-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6" released by "delete_volume" :: held 0.722s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:08 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-009d13ba-3100-41f3-bace-252444d3857c tempest-ProjectReaderTests-1828620363 None] Created reservations ['4a1894e7-2680-4a67-a0fe-d40864d9ffa8', '62dfbf9a-e3cf-4700-bac9-fd1774c1a240', 'de06b777-016e-438b-a0dd-0e6f1f68287d', '58a3e88f-3ae2-48d3-90d3-e581005a35e1'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:47:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-009d13ba-3100-41f3-bace-252444d3857c tempest-ProjectReaderTests-1828620363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-009d13ba-3100-41f3-bace-252444d3857c tempest-ProjectReaderTests-1828620363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-009d13ba-3100-41f3-bace-252444d3857c tempest-ProjectReaderTests-1828620363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:08 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-009d13ba-3100-41f3-bace-252444d3857c tempest-ProjectReaderTests-1828620363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-009d13ba-3100-41f3-bace-252444d3857c tempest-ProjectReaderTests-1828620363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-009d13ba-3100-41f3-bace-252444d3857c tempest-ProjectReaderTests-1828620363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:08 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:47:08 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:08 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3eb22e2a-9383-48d9-a4d7-094ca83d3754 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0" returned: 0 in 0.412s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3eb22e2a-9383-48d9-a4d7-094ca83d3754 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.1fba810d-a586-4110-8d13-43200a6237df 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:08 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.1fba810d-a586-4110-8d13-43200a6237df 1G Nov 03 07:47:08 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:08 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-009d13ba-3100-41f3-bace-252444d3857c tempest-ProjectReaderTests-1828620363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.275s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:08 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-009d13ba-3100-41f3-bace-252444d3857c tempest-ProjectReaderTests-1828620363 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:47:08 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-009d13ba-3100-41f3-bace-252444d3857c tempest-ProjectReaderTests-1828620363 None] Deleted volume successfully. Nov 03 07:47:08 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-009d13ba-3100-41f3-bace-252444d3857c tempest-ProjectReaderTests-1828620363 None] Lock "cinder-93f5dd3b-4cb3-4ab9-9a24-23a0b5d810d6-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:08 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3eb22e2a-9383-48d9-a4d7-094ca83d3754 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.1fba810d-a586-4110-8d13-43200a6237df 1G" returned: 0 in 0.438s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3eb22e2a-9383-48d9-a4d7-094ca83d3754 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaaf2091-224b-49d9-988b-d0d50998add0 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.1fba810d-a586-4110-8d13-43200a6237df {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:08 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaaf2091-224b-49d9-988b-d0d50998add0 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.1fba810d-a586-4110-8d13-43200a6237df Nov 03 07:47:08 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:08 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3eb22e2a-9383-48d9-a4d7-094ca83d3754 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaaf2091-224b-49d9-988b-d0d50998add0 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.1fba810d-a586-4110-8d13-43200a6237df" returned: 0 in 0.302s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:08 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-3eb22e2a-9383-48d9-a4d7-094ca83d3754 tempest-ProjectMemberTests-2017513802 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.1fba810d-a586-4110-8d13-43200a6237df is being set with open permissions: ugo+rw Nov 03 07:47:08 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3eb22e2a-9383-48d9-a4d7-094ca83d3754 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.1fba810d-a586-4110-8d13-43200a6237df {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:08 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.1fba810d-a586-4110-8d13-43200a6237df Nov 03 07:47:08 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:09 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3eb22e2a-9383-48d9-a4d7-094ca83d3754 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.1fba810d-a586-4110-8d13-43200a6237df" returned: 0 in 0.246s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3eb22e2a-9383-48d9-a4d7-094ca83d3754 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:09 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.info Nov 03 07:47:09 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:09 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3eb22e2a-9383-48d9-a4d7-094ca83d3754 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.info" returned: 0 in 0.281s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:09 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-3eb22e2a-9383-48d9-a4d7-094ca83d3754 tempest-ProjectMemberTests-2017513802 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.info is being set with open permissions: ugo+rw Nov 03 07:47:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3eb22e2a-9383-48d9-a4d7-094ca83d3754 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:09 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.info Nov 03 07:47:09 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:09 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-3eb22e2a-9383-48d9-a4d7-094ca83d3754 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.info" returned: 0 in 0.303s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:09 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-3eb22e2a-9383-48d9-a4d7-094ca83d3754 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.074s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:09 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-3eb22e2a-9383-48d9-a4d7-094ca83d3754 tempest-ProjectMemberTests-2017513802 None] Create snapshot completed successfully Nov 03 07:47:11 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-75be7f14-5e66-4255-b80e-d159623433d9 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-1fba810d-a586-4110-8d13-43200a6237df-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:11 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-75be7f14-5e66-4255-b80e-d159623433d9 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-1fba810d-a586-4110-8d13-43200a6237df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:11 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-75be7f14-5e66-4255-b80e-d159623433d9 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-aaaf2091-224b-49d9-988b-d0d50998add0" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:11 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-75be7f14-5e66-4255-b80e-d159623433d9 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-aaaf2091-224b-49d9-988b-d0d50998add0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:11 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-75be7f14-5e66-4255-b80e-d159623433d9 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-1fba810d-a586-4110-8d13-43200a6237df" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:11 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-75be7f14-5e66-4255-b80e-d159623433d9 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-1fba810d-a586-4110-8d13-43200a6237df" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:11 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-75be7f14-5e66-4255-b80e-d159623433d9 tempest-ProjectMemberTests-2017513802 None] Deleting offline snapshot 1fba810d-a586-4110-8d13-43200a6237df of volume aaaf2091-224b-49d9-988b-d0d50998add0 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:47:11 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-75be7f14-5e66-4255-b80e-d159623433d9 tempest-ProjectMemberTests-2017513802 None] snapshot_file for this snap is: volume-aaaf2091-224b-49d9-988b-d0d50998add0.1fba810d-a586-4110-8d13-43200a6237df {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:47:11 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea6c6bb-a9c3-4ec5-a68d-68144c79205e]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-75be7f14-5e66-4255-b80e-d159623433d9 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.1fba810d-a586-4110-8d13-43200a6237df {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:11 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.1fba810d-a586-4110-8d13-43200a6237df Nov 03 07:47:11 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:11 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-75be7f14-5e66-4255-b80e-d159623433d9 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.1fba810d-a586-4110-8d13-43200a6237df" returned: 0 in 0.394s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:11 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-75be7f14-5e66-4255-b80e-d159623433d9 tempest-ProjectMemberTests-2017513802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aaaf2091-224b-49d9-988b-d0d50998add0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:47:11 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7e4bdb-d9de-48b4-bea1-9f4939198ad0]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-75be7f14-5e66-4255-b80e-d159623433d9 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:11 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0 Nov 03 07:47:11 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:11 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-75be7f14-5e66-4255-b80e-d159623433d9 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0" returned: 0 in 0.384s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:11 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-75be7f14-5e66-4255-b80e-d159623433d9 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.1fba810d-a586-4110-8d13-43200a6237df {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:11 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.1fba810d-a586-4110-8d13-43200a6237df Nov 03 07:47:11 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:12 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-75be7f14-5e66-4255-b80e-d159623433d9 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.1fba810d-a586-4110-8d13-43200a6237df" returned: 0 in 0.391s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-75be7f14-5e66-4255-b80e-d159623433d9 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.1fba810d-a586-4110-8d13-43200a6237df {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:12 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.1fba810d-a586-4110-8d13-43200a6237df Nov 03 07:47:12 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:12 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:12 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-75be7f14-5e66-4255-b80e-d159623433d9 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0.1fba810d-a586-4110-8d13-43200a6237df" returned: 0 in 0.279s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-75be7f14-5e66-4255-b80e-d159623433d9 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-1fba810d-a586-4110-8d13-43200a6237df" released by "_delete_snapshot" :: held 1.570s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-75be7f14-5e66-4255-b80e-d159623433d9 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-aaaf2091-224b-49d9-988b-d0d50998add0" released by "delete_snapshot" :: held 1.595s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:12 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-75be7f14-5e66-4255-b80e-d159623433d9 tempest-ProjectMemberTests-2017513802 None] Created reservations ['36d5a6ca-d3c2-4be3-b0a7-21ef62e0255d', '57584374-a2a1-4a47-b81d-a1c371dad5f7', 'c2a2570c-f528-46fd-8f9a-fcfdfa01c22f', '4483ee66-db17-4bb7-9e2e-fbe14473de85'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:47:12 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-75be7f14-5e66-4255-b80e-d159623433d9 tempest-ProjectMemberTests-2017513802 None] Delete snapshot completed successfully. Nov 03 07:47:12 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-75be7f14-5e66-4255-b80e-d159623433d9 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-1fba810d-a586-4110-8d13-43200a6237df-delete_snapshot" released by "delete_snapshot" :: held 1.719s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f38c2e15-df3b-49d1-a71e-bd542aae9d10 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-aaaf2091-224b-49d9-988b-d0d50998add0-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f38c2e15-df3b-49d1-a71e-bd542aae9d10 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-aaaf2091-224b-49d9-988b-d0d50998add0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f38c2e15-df3b-49d1-a71e-bd542aae9d10 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "cinder-quobyte-aaaf2091-224b-49d9-988b-d0d50998add0" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f38c2e15-df3b-49d1-a71e-bd542aae9d10 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-aaaf2091-224b-49d9-988b-d0d50998add0" acquired by "delete_volume" :: waited 0.019s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:13 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5aaf2a-a3cf-4a95-81c7-d4e0cb470647]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f38c2e15-df3b-49d1-a71e-bd542aae9d10 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:13 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0 Nov 03 07:47:13 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:13 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f38c2e15-df3b-49d1-a71e-bd542aae9d10 tempest-ProjectMemberTests-2017513802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0" returned: 0 in 0.377s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f38c2e15-df3b-49d1-a71e-bd542aae9d10 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:13 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0 Nov 03 07:47:13 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:13 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:13 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f38c2e15-df3b-49d1-a71e-bd542aae9d10 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-aaaf2091-224b-49d9-988b-d0d50998add0" returned: 0 in 0.264s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:13 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f38c2e15-df3b-49d1-a71e-bd542aae9d10 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-quobyte-aaaf2091-224b-49d9-988b-d0d50998add0" released by "delete_volume" :: held 0.708s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:14 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-f38c2e15-df3b-49d1-a71e-bd542aae9d10 tempest-ProjectMemberTests-2017513802 None] Created reservations ['cdaa5ffd-a334-437a-a8b0-3f6e82279dc8', 'ab8722ca-1aea-4609-8c6b-ca16ff3a2406', '76974461-b69f-4471-915a-8a5df973ad7c', 'a760b51a-797e-43d0-b936-f2c13ecad38d'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:47:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f38c2e15-df3b-49d1-a71e-bd542aae9d10 tempest-ProjectMemberTests-2017513802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f38c2e15-df3b-49d1-a71e-bd542aae9d10 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f38c2e15-df3b-49d1-a71e-bd542aae9d10 tempest-ProjectMemberTests-2017513802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:14 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-f38c2e15-df3b-49d1-a71e-bd542aae9d10 tempest-ProjectMemberTests-2017513802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-f38c2e15-df3b-49d1-a71e-bd542aae9d10 tempest-ProjectMemberTests-2017513802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f38c2e15-df3b-49d1-a71e-bd542aae9d10 tempest-ProjectMemberTests-2017513802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:14 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:47:14 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:14 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:14 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-f38c2e15-df3b-49d1-a71e-bd542aae9d10 tempest-ProjectMemberTests-2017513802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.319s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:14 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-f38c2e15-df3b-49d1-a71e-bd542aae9d10 tempest-ProjectMemberTests-2017513802 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:47:14 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-f38c2e15-df3b-49d1-a71e-bd542aae9d10 tempest-ProjectMemberTests-2017513802 None] Deleted volume successfully. Nov 03 07:47:14 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-f38c2e15-df3b-49d1-a71e-bd542aae9d10 tempest-ProjectMemberTests-2017513802 None] Lock "cinder-aaaf2091-224b-49d9-988b-d0d50998add0-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:24 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:DELETE=6,cinder:SELECT=38,cinder:INSERT=16,cinder:UPDATE=51 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:47:24 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:UPDATE=47,cinder:SELECT=35,cinder:INSERT=12,cinder:DELETE=2 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:47:46 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:47:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Flow 'volume_create_manager' (bbf8c196-91c9-4e34-9882-925f67ffc86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83bf206-e7b7-46a2-99a3-9a367b9660c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83bf206-e7b7-46a2-99a3-9a367b9660c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1030999233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2130864d-2fb7-4b4f-bf67-6221aabb0160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e843684ac9049299c392b11af0aff5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:47Z,use_quota=True,user_id='7935bd92126949499f337feb048e2768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4699f9a5-4f9c-48fb-9175-c3c228985df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4699f9a5-4f9c-48fb-9175-c3c228985df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5064295f-d601-4a19-af70-0b147876df9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5064295f-d601-4a19-af70-0b147876df9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2130864d-2fb7-4b4f-bf67-6221aabb0160', 'volume_name': 'volume-2130864d-2fb7-4b4f-bf67-6221aabb0160', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3ebd71-d4de-4dd1-b31f-7560f836396f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3ebd71-d4de-4dd1-b31f-7560f836396f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:46 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c682bda-3a3a-4997-997e-eeb4f9b7be61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:46 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Volume 2130864d-2fb7-4b4f-bf67-6221aabb0160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2130864d-2fb7-4b4f-bf67-6221aabb0160', 'volume_size': 1} Nov 03 07:47:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1030999233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2130864d-2fb7-4b4f-bf67-6221aabb0160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e843684ac9049299c392b11af0aff5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:47Z,use_quota=True,user_id='7935bd92126949499f337feb048e2768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)}" {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 03 07:47:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Creating volume 2130864d-2fb7-4b4f-bf67-6221aabb0160 {{(pid=87016) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:47:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:46 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:47:46 devstack cinder-volume[87016]: INFO cinder.volume.drivers.remotefs [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] casted to osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 Nov 03 07:47:46 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160 1073741824 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:46 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160 1073741824 Nov 03 07:47:46 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:47 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160 1073741824" returned: 0 in 0.428s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:47 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160 Nov 03 07:47:47 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:47 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160" returned: 0 in 0.262s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:47 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'} {{(pid=87016) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 03 07:47:47 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c682bda-3a3a-4997-997e-eeb4f9b7be61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2130864d-2fb7-4b4f-bf67-6221aabb0160', 'volume_size': 1}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dfec69a-ef12-4573-a9e0-d14c8e2e55ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:47 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Volume volume-2130864d-2fb7-4b4f-bf67-6221aabb0160 (2130864d-2fb7-4b4f-bf67-6221aabb0160): created successfully Nov 03 07:47:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dfec69a-ef12-4573-a9e0-d14c8e2e55ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:47 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Flow 'volume_create_manager' (bbf8c196-91c9-4e34-9882-925f67ffc86f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:47 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-539b55ae-2482-4858-84bf-31dd62eb5519 tempest-SnapshotDependencyTests-1856908121 None] Created volume successfully. Nov 03 07:47:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9dd1db19-e7f3-4925-9b8d-4b975d231e90 tempest-SnapshotDependencyTests-1856908121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9dd1db19-e7f3-4925-9b8d-4b975d231e90 tempest-SnapshotDependencyTests-1856908121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:48 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-9dd1db19-e7f3-4925-9b8d-4b975d231e90 tempest-SnapshotDependencyTests-1856908121 None] Creating offline snapshot 4251b1a0-519f-45d0-912a-4e381777ab0c of volume 2130864d-2fb7-4b4f-bf67-6221aabb0160 {{(pid=87016) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:47:48 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[6142fb67-294f-482e-b167-3d896fa7c3e6]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9dd1db19-e7f3-4925-9b8d-4b975d231e90 tempest-SnapshotDependencyTests-1856908121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:48 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160 Nov 03 07:47:48 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:48 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9dd1db19-e7f3-4925-9b8d-4b975d231e90 tempest-SnapshotDependencyTests-1856908121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160" returned: 0 in 0.355s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9dd1db19-e7f3-4925-9b8d-4b975d231e90 tempest-SnapshotDependencyTests-1856908121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.4251b1a0-519f-45d0-912a-4e381777ab0c 1G {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:48 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.4251b1a0-519f-45d0-912a-4e381777ab0c 1G Nov 03 07:47:48 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:48 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9dd1db19-e7f3-4925-9b8d-4b975d231e90 tempest-SnapshotDependencyTests-1856908121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.4251b1a0-519f-45d0-912a-4e381777ab0c 1G" returned: 0 in 0.390s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:48 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9dd1db19-e7f3-4925-9b8d-4b975d231e90 tempest-SnapshotDependencyTests-1856908121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2130864d-2fb7-4b4f-bf67-6221aabb0160 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.4251b1a0-519f-45d0-912a-4e381777ab0c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:48 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2130864d-2fb7-4b4f-bf67-6221aabb0160 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.4251b1a0-519f-45d0-912a-4e381777ab0c Nov 03 07:47:48 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:49 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9dd1db19-e7f3-4925-9b8d-4b975d231e90 tempest-SnapshotDependencyTests-1856908121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2130864d-2fb7-4b4f-bf67-6221aabb0160 -F qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.4251b1a0-519f-45d0-912a-4e381777ab0c" returned: 0 in 0.301s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:49 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-9dd1db19-e7f3-4925-9b8d-4b975d231e90 tempest-SnapshotDependencyTests-1856908121 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.4251b1a0-519f-45d0-912a-4e381777ab0c is being set with open permissions: ugo+rw Nov 03 07:47:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9dd1db19-e7f3-4925-9b8d-4b975d231e90 tempest-SnapshotDependencyTests-1856908121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.4251b1a0-519f-45d0-912a-4e381777ab0c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:47:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:49 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:49 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.4251b1a0-519f-45d0-912a-4e381777ab0c Nov 03 07:47:49 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:49 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:47:49 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:49 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9dd1db19-e7f3-4925-9b8d-4b975d231e90 tempest-SnapshotDependencyTests-1856908121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.4251b1a0-519f-45d0-912a-4e381777ab0c" returned: 0 in 0.276s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:49 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.273s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:49 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:47:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9dd1db19-e7f3-4925-9b8d-4b975d231e90 tempest-SnapshotDependencyTests-1856908121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:49 devstack cinder-volume[87016]: DEBUG oslo_service.periodic_task [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] Running periodic task VolumeManager._thread_info {{(pid=87016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:47:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread count: 28 {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:47:49 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-a616a698-15dc-4b16-a0f2-ca4fe61a90cb None None] thread info: [<_MainThread(MainThread, started 134460067078272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:47:49 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.info Nov 03 07:47:49 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:49 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9dd1db19-e7f3-4925-9b8d-4b975d231e90 tempest-SnapshotDependencyTests-1856908121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.info" returned: 0 in 0.259s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:49 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-9dd1db19-e7f3-4925-9b8d-4b975d231e90 tempest-SnapshotDependencyTests-1856908121 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.info is being set with open permissions: ugo+rw Nov 03 07:47:49 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9dd1db19-e7f3-4925-9b8d-4b975d231e90 tempest-SnapshotDependencyTests-1856908121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.info {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:49 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.info Nov 03 07:47:49 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:49 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-9dd1db19-e7f3-4925-9b8d-4b975d231e90 tempest-SnapshotDependencyTests-1856908121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.info" returned: 0 in 0.269s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-9dd1db19-e7f3-4925-9b8d-4b975d231e90 tempest-SnapshotDependencyTests-1856908121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.955s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:50 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-9dd1db19-e7f3-4925-9b8d-4b975d231e90 tempest-SnapshotDependencyTests-1856908121 None] Create snapshot completed successfully Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG cinder.volume.flows.manager.create_volume [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87016) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Flow 'volume_create_manager' (14e649b3-6c59-49ca-acc3-0bd1a6669a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb9efb3-5339-4a28-8304-a3771e61cd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb9efb3-5339-4a28-8304-a3771e61cd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a6374b-4ba1-4cff-b260-0d7eeb86d7e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e843684ac9049299c392b11af0aff5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4251b1a0-519f-45d0-912a-4e381777ab0c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:51Z,use_quota=True,user_id='7935bd92126949499f337feb048e2768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2feeb38-4bc7-44d3-b535-428b781bc363),volume_type_id=b2feeb38-4bc7-44d3-b535-428b781bc363)' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7c4581-9298-4375-b9f9-3da955147273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7c4581-9298-4375-b9f9-3da955147273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eae107a-6a7c-43b7-b86e-3109ed7085a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eae107a-6a7c-43b7-b86e-3109ed7085a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '41a6374b-4ba1-4cff-b260-0d7eeb86d7e3', 'volume_name': 'volume-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3', 'volume_size': 1, 'snapshot_id': '4251b1a0-519f-45d0-912a-4e381777ab0c'}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e221da-0d9a-4190-aec3-b74555ee11dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e221da-0d9a-4190-aec3-b74555ee11dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b56804-226f-4ca4-abc4-2b8928a48ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:50 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Volume 41a6374b-4ba1-4cff-b260-0d7eeb86d7e3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3', 'volume_size': 1, 'snapshot_id': '4251b1a0-519f-45d0-912a-4e381777ab0c'} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Acquiring lock "cinder-quobyte-4251b1a0-519f-45d0-912a-4e381777ab0c-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3" by "_create_volume_from_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Lock "cinder-quobyte-4251b1a0-519f-45d0-912a-4e381777ab0c-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Creating volume 41a6374b-4ba1-4cff-b260-0d7eeb86d7e3 from snapshot 4251b1a0-519f-45d0-912a-4e381777ab0c {{(pid=87016) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Selected osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14 as target Quobyte volume. {{(pid=87016) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Acquiring lock "cinder-quobyte-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3" by "_copy_volume_from_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Lock "cinder-quobyte-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] snapshot: 4251b1a0-519f-45d0-912a-4e381777ab0c, volume: 41a6374b-4ba1-4cff-b260-0d7eeb86d7e3, {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:50 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:51 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[2294fee2-7dcb-4cd6-b5b5-e3c0aa340885]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.4251b1a0-519f-45d0-912a-4e381777ab0c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:51 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.4251b1a0-519f-45d0-912a-4e381777ab0c Nov 03 07:47:51 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:51 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.4251b1a0-519f-45d0-912a-4e381777ab0c" returned: 0 in 0.385s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2130864d-2fb7-4b4f-bf67-6221aabb0160(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:47:51 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfdd1c2-7c29-4bcb-9393-9278d08c2e5e]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:51 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160 Nov 03 07:47:51 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:51 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160" returned: 0 in 0.386s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] will copy from snapshot at /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160 {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:47:51 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Creating direct copy from snapshot {{(pid=87016) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:47:51 devstack cinder-volume[87016]: DEBUG cinder.utils [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Path /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3 not found in is_blk_device check {{(pid=87016) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 03 07:47:51 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:51 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3 Nov 03 07:47:51 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:57 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3" returned: 0 in 5.346s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:57 devstack cinder-volume[87016]: DEBUG cinder.image.image_utils [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Image conversion details: src /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160, size 1024.00 MB, duration 5.35 sec, destination /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3 {{(pid=87016) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:47:57 devstack cinder-volume[87016]: INFO cinder.image.image_utils [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Converted 1024.00 MB image at 191.50 MB/s Nov 03 07:47:57 devstack cinder-volume[87016]: WARNING cinder.volume.drivers.remotefs [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3 is being set with open permissions: ugo+rw Nov 03 07:47:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:57 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3 Nov 03 07:47:57 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:57 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3" returned: 0 in 0.225s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Lock "cinder-quobyte-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3" released by "_copy_volume_from_snapshot" :: held 6.426s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:57 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Lock "cinder-quobyte-4251b1a0-519f-45d0-912a-4e381777ab0c-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3" released by "_create_volume_from_snapshot" :: held 6.484s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:57 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.499s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b56804-226f-4ca4-abc4-2b8928a48ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3', 'volume_size': 1, 'snapshot_id': '4251b1a0-519f-45d0-912a-4e381777ab0c'}' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d34225-6305-409e-a8e9-f7a60ecf50ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:57 devstack cinder-volume[87016]: INFO cinder.volume.flows.manager.create_volume [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Volume volume-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3 (41a6374b-4ba1-4cff-b260-0d7eeb86d7e3): created successfully Nov 03 07:47:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d34225-6305-409e-a8e9-f7a60ecf50ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87016) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:57 devstack cinder-volume[87016]: DEBUG cinder.volume.manager [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Flow 'volume_create_manager' (14e649b3-6c59-49ca-acc3-0bd1a6669a34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87016) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:57 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-2428af45-e708-4635-b4df-3d96c3da475b tempest-SnapshotDependencyTests-1856908121 None] Created volume successfully. Nov 03 07:47:58 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d4997e32-a7af-4049-89d3-28e1b837456e tempest-SnapshotDependencyTests-1856908121 None] Acquiring lock "cinder-4251b1a0-519f-45d0-912a-4e381777ab0c-delete_snapshot" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:58 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d4997e32-a7af-4049-89d3-28e1b837456e tempest-SnapshotDependencyTests-1856908121 None] Lock "cinder-4251b1a0-519f-45d0-912a-4e381777ab0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:58 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d4997e32-a7af-4049-89d3-28e1b837456e tempest-SnapshotDependencyTests-1856908121 None] Acquiring lock "cinder-quobyte-2130864d-2fb7-4b4f-bf67-6221aabb0160" by "delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:58 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d4997e32-a7af-4049-89d3-28e1b837456e tempest-SnapshotDependencyTests-1856908121 None] Lock "cinder-quobyte-2130864d-2fb7-4b4f-bf67-6221aabb0160" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:58 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d4997e32-a7af-4049-89d3-28e1b837456e tempest-SnapshotDependencyTests-1856908121 None] Acquiring lock "cinder-quobyte-4251b1a0-519f-45d0-912a-4e381777ab0c" by "_delete_snapshot" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:58 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d4997e32-a7af-4049-89d3-28e1b837456e tempest-SnapshotDependencyTests-1856908121 None] Lock "cinder-quobyte-4251b1a0-519f-45d0-912a-4e381777ab0c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-d4997e32-a7af-4049-89d3-28e1b837456e tempest-SnapshotDependencyTests-1856908121 None] Deleting offline snapshot 4251b1a0-519f-45d0-912a-4e381777ab0c of volume 2130864d-2fb7-4b4f-bf67-6221aabb0160 {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:47:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-d4997e32-a7af-4049-89d3-28e1b837456e tempest-SnapshotDependencyTests-1856908121 None] snapshot_file for this snap is: volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.4251b1a0-519f-45d0-912a-4e381777ab0c {{(pid=87016) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:47:58 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6efbe0-da66-49cc-8e2c-d8d9430db97e]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d4997e32-a7af-4049-89d3-28e1b837456e tempest-SnapshotDependencyTests-1856908121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.4251b1a0-519f-45d0-912a-4e381777ab0c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:58 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.4251b1a0-519f-45d0-912a-4e381777ab0c Nov 03 07:47:58 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:58 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d4997e32-a7af-4049-89d3-28e1b837456e tempest-SnapshotDependencyTests-1856908121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.4251b1a0-519f-45d0-912a-4e381777ab0c" returned: 0 in 0.345s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:58 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.remotefs [None req-d4997e32-a7af-4049-89d3-28e1b837456e tempest-SnapshotDependencyTests-1856908121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2130864d-2fb7-4b4f-bf67-6221aabb0160(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87016) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:47:58 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb062220-0cab-4a84-a955-4b1f9962457f]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:58 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d4997e32-a7af-4049-89d3-28e1b837456e tempest-SnapshotDependencyTests-1856908121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:58 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160 Nov 03 07:47:58 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:59 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d4997e32-a7af-4049-89d3-28e1b837456e tempest-SnapshotDependencyTests-1856908121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160" returned: 0 in 0.512s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d4997e32-a7af-4049-89d3-28e1b837456e tempest-SnapshotDependencyTests-1856908121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.4251b1a0-519f-45d0-912a-4e381777ab0c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:59 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.4251b1a0-519f-45d0-912a-4e381777ab0c Nov 03 07:47:59 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:59 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d4997e32-a7af-4049-89d3-28e1b837456e tempest-SnapshotDependencyTests-1856908121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.4251b1a0-519f-45d0-912a-4e381777ab0c" returned: 0 in 0.319s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d4997e32-a7af-4049-89d3-28e1b837456e tempest-SnapshotDependencyTests-1856908121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.4251b1a0-519f-45d0-912a-4e381777ab0c {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:59 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.4251b1a0-519f-45d0-912a-4e381777ab0c Nov 03 07:47:59 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:59 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:59 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-d4997e32-a7af-4049-89d3-28e1b837456e tempest-SnapshotDependencyTests-1856908121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160.4251b1a0-519f-45d0-912a-4e381777ab0c" returned: 0 in 0.236s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d4997e32-a7af-4049-89d3-28e1b837456e tempest-SnapshotDependencyTests-1856908121 None] Lock "cinder-quobyte-4251b1a0-519f-45d0-912a-4e381777ab0c" released by "_delete_snapshot" :: held 1.508s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:59 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d4997e32-a7af-4049-89d3-28e1b837456e tempest-SnapshotDependencyTests-1856908121 None] Lock "cinder-quobyte-2130864d-2fb7-4b4f-bf67-6221aabb0160" released by "delete_snapshot" :: held 1.529s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:59 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-d4997e32-a7af-4049-89d3-28e1b837456e tempest-SnapshotDependencyTests-1856908121 None] Created reservations ['0e361f13-1f56-412f-a130-1e00a0c05e53', 'df2496bb-8972-4eee-a6ed-6bc4cadab591', 'bfa92d71-cde3-4d00-b7b9-49a1c311b3e7', 'a353bf03-4360-461a-9e62-4a560fff6b4d'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:48:00 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-d4997e32-a7af-4049-89d3-28e1b837456e tempest-SnapshotDependencyTests-1856908121 None] Delete snapshot completed successfully. Nov 03 07:48:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-d4997e32-a7af-4049-89d3-28e1b837456e tempest-SnapshotDependencyTests-1856908121 None] Lock "cinder-4251b1a0-519f-45d0-912a-4e381777ab0c-delete_snapshot" released by "delete_snapshot" :: held 1.658s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-644b1440-337a-4e41-a87a-5f793fcdb17d tempest-SnapshotDependencyTests-1856908121 None] Acquiring lock "cinder-2130864d-2fb7-4b4f-bf67-6221aabb0160-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:48:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-644b1440-337a-4e41-a87a-5f793fcdb17d tempest-SnapshotDependencyTests-1856908121 None] Lock "cinder-2130864d-2fb7-4b4f-bf67-6221aabb0160-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:48:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-644b1440-337a-4e41-a87a-5f793fcdb17d tempest-SnapshotDependencyTests-1856908121 None] Acquiring lock "cinder-quobyte-2130864d-2fb7-4b4f-bf67-6221aabb0160" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:48:00 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-644b1440-337a-4e41-a87a-5f793fcdb17d tempest-SnapshotDependencyTests-1856908121 None] Lock "cinder-quobyte-2130864d-2fb7-4b4f-bf67-6221aabb0160" acquired by "delete_volume" :: waited 0.012s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:48:00 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8682201-9b16-4ff8-b246-5c182797fb26]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:48:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-644b1440-337a-4e41-a87a-5f793fcdb17d tempest-SnapshotDependencyTests-1856908121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:00 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160 Nov 03 07:48:00 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:00 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-644b1440-337a-4e41-a87a-5f793fcdb17d tempest-SnapshotDependencyTests-1856908121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160" returned: 0 in 0.363s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:00 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-644b1440-337a-4e41-a87a-5f793fcdb17d tempest-SnapshotDependencyTests-1856908121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:00 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160 Nov 03 07:48:00 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:01 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-644b1440-337a-4e41-a87a-5f793fcdb17d tempest-SnapshotDependencyTests-1856908121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-2130864d-2fb7-4b4f-bf67-6221aabb0160" returned: 0 in 0.260s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-644b1440-337a-4e41-a87a-5f793fcdb17d tempest-SnapshotDependencyTests-1856908121 None] Lock "cinder-quobyte-2130864d-2fb7-4b4f-bf67-6221aabb0160" released by "delete_volume" :: held 0.683s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:01 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-644b1440-337a-4e41-a87a-5f793fcdb17d tempest-SnapshotDependencyTests-1856908121 None] Created reservations ['5a4d5511-3d30-4344-bdc5-9bda2ee569cf', '1a780b74-a899-4778-ad5f-d1d5209210b4', 'de37673e-3c7c-40f0-8637-fa19f901b46e', '49860073-b604-47d3-bda9-780f0728e8f1'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:48:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-644b1440-337a-4e41-a87a-5f793fcdb17d tempest-SnapshotDependencyTests-1856908121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:48:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-644b1440-337a-4e41-a87a-5f793fcdb17d tempest-SnapshotDependencyTests-1856908121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:48:01 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-644b1440-337a-4e41-a87a-5f793fcdb17d tempest-SnapshotDependencyTests-1856908121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:48:01 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-644b1440-337a-4e41-a87a-5f793fcdb17d tempest-SnapshotDependencyTests-1856908121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:48:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-644b1440-337a-4e41-a87a-5f793fcdb17d tempest-SnapshotDependencyTests-1856908121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:48:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-644b1440-337a-4e41-a87a-5f793fcdb17d tempest-SnapshotDependencyTests-1856908121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:01 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:48:01 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:01 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-644b1440-337a-4e41-a87a-5f793fcdb17d tempest-SnapshotDependencyTests-1856908121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.238s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:01 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-644b1440-337a-4e41-a87a-5f793fcdb17d tempest-SnapshotDependencyTests-1856908121 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:48:01 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-644b1440-337a-4e41-a87a-5f793fcdb17d tempest-SnapshotDependencyTests-1856908121 None] Deleted volume successfully. Nov 03 07:48:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-644b1440-337a-4e41-a87a-5f793fcdb17d tempest-SnapshotDependencyTests-1856908121 None] Lock "cinder-2130864d-2fb7-4b4f-bf67-6221aabb0160-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1b464732-bb56-463c-9afb-4ce6255b63ba tempest-SnapshotDependencyTests-1856908121 None] Acquiring lock "cinder-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3-delete_volume" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:48:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1b464732-bb56-463c-9afb-4ce6255b63ba tempest-SnapshotDependencyTests-1856908121 None] Lock "cinder-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:48:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1b464732-bb56-463c-9afb-4ce6255b63ba tempest-SnapshotDependencyTests-1856908121 None] Acquiring lock "cinder-quobyte-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3" by "delete_volume" {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:48:01 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1b464732-bb56-463c-9afb-4ce6255b63ba tempest-SnapshotDependencyTests-1856908121 None] Lock "cinder-quobyte-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3" acquired by "delete_volume" :: waited 0.018s {{(pid=87016) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:48:01 devstack cinder-volume[87016]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74172f9-d2a6-4d09-931e-449f10c6a0e7]: (4, 'qcow2') {{(pid=87753) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:48:01 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1b464732-bb56-463c-9afb-4ce6255b63ba tempest-SnapshotDependencyTests-1856908121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:01 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3 Nov 03 07:48:01 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:02 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1b464732-bb56-463c-9afb-4ce6255b63ba tempest-SnapshotDependencyTests-1856908121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3" returned: 0 in 0.363s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1b464732-bb56-463c-9afb-4ce6255b63ba tempest-SnapshotDependencyTests-1856908121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3 {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:02 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3 Nov 03 07:48:02 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:02 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1b464732-bb56-463c-9afb-4ce6255b63ba tempest-SnapshotDependencyTests-1856908121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f/volume-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3" returned: 0 in 0.242s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:02 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1b464732-bb56-463c-9afb-4ce6255b63ba tempest-SnapshotDependencyTests-1856908121 None] Lock "cinder-quobyte-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3" released by "delete_volume" :: held 0.645s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:02 devstack cinder-volume[87016]: DEBUG cinder.quota [None req-1b464732-bb56-463c-9afb-4ce6255b63ba tempest-SnapshotDependencyTests-1856908121 None] Created reservations ['66e003ca-87cb-40e8-8e34-ecfeee0fa4a3', 'fb954b82-f40d-47ed-8373-6c75fdd2279a', 'f6d4234b-72c9-49f3-9d99-99e95f40bafa', '06c8effc-9d8f-4bfb-842c-8b1724c53ad9'] {{(pid=87016) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:48:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1b464732-bb56-463c-9afb-4ce6255b63ba tempest-SnapshotDependencyTests-1856908121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:48:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1b464732-bb56-463c-9afb-4ce6255b63ba tempest-SnapshotDependencyTests-1856908121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:48:02 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1b464732-bb56-463c-9afb-4ce6255b63ba tempest-SnapshotDependencyTests-1856908121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14': None} {{(pid=87016) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:48:02 devstack cinder-volume[87016]: DEBUG cinder.volume.drivers.quobyte [None req-1b464732-bb56-463c-9afb-4ce6255b63ba tempest-SnapshotDependencyTests-1856908121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ad3588a-3bad-4450-b149-0ea385f9df14'] {{(pid=87016) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:48:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.lockutils [None req-1b464732-bb56-463c-9afb-4ce6255b63ba tempest-SnapshotDependencyTests-1856908121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87016) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:48:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1b464732-bb56-463c-9afb-4ce6255b63ba tempest-SnapshotDependencyTests-1856908121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:02 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f Nov 03 07:48:02 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:02 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:02 devstack cinder-volume[87016]: DEBUG oslo_concurrency.processutils [None req-1b464732-bb56-463c-9afb-4ce6255b63ba tempest-SnapshotDependencyTests-1856908121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/95f72a092988911abb707713fbea230f" returned: 0 in 0.240s {{(pid=87016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:02 devstack cinder-volume[87016]: DEBUG cinder.manager [None req-1b464732-bb56-463c-9afb-4ce6255b63ba tempest-SnapshotDependencyTests-1856908121 None] Notifying Schedulers of capabilities ... {{(pid=87016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:48:02 devstack cinder-volume[87016]: INFO cinder.volume.manager [None req-1b464732-bb56-463c-9afb-4ce6255b63ba tempest-SnapshotDependencyTests-1856908121 None] Deleted volume successfully. Nov 03 07:48:02 devstack cinder-volume[87016]: DEBUG cinder.coordination [None req-1b464732-bb56-463c-9afb-4ce6255b63ba tempest-SnapshotDependencyTests-1856908121 None] Lock "cinder-41a6374b-4ba1-4cff-b260-0d7eeb86d7e3-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=87016) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:12 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=26,cinder:UPDATE=30,cinder:INSERT=10 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:48:12 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:UPDATE=28,cinder:SELECT=23,cinder:INSERT=5,cinder:DELETE=5 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:48:27 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:SELECT=1 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:48:27 devstack cinder-volume[87016]: DEBUG dbcounter [-] [87016] Writing DB stats cinder:UPDATE=1 {{(pid=87016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}